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ABSTRACT 

The participation in certain classroom processes by 
students of high and low mathematics confidence who scored above the 
mean in mathematics achievement was studied over 2 yaars. The 
processes selected were; (1) specified types of teacher-pupil 
interactions, and (2) student engaged time in high or low cognitive 
level mathematical activities, spatial activities, and with peers. 
Eighty-two seventh graders were observed daily in their regular 
mathematics classes for 3 to 4 weeks during the spring semester of 
1980, and were again observed in 1981. Between 3 and 14 target 
students were within each observed class. Roughly equal numbers of 
each sex were chosen based on the following characteristics for the 
sample: (1) mathematics achievement scores were at or above the 
sixth-grade mean of four middle schools, and (2) confidence in 
mathematics scores were in either the top or bottom quarter for all 
pupils who had achieved higher than the mean. Two trained observers 
recorded data on target student and teacher behavior in each 
classroom. Data were collapsed across classrooms and analyzed using 
analysis of variance, with sex, confidence level, and year as 
factors. (MP) 
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Abstract 

Studied was the participation in certain classroom processes over a two 
year period by girls and boys of high and low confidence in mathematics who 
scored above the mean in mathematics achievement. The classroom processes 
selected were (1) specified types of teacher-pupil interactions, and (2) 
student engaged time in high or low cognitive level mathematical activities, 
spatial activities, and with peers. Approximately equal numbers of seventh grade 
girls and boys who had the following characteristics were selected for the 
sample: (1) Mathematics achievement scores were at or above the mean of all 
sixth graders in four middle schools, and (2) Confidence in mathematics scores 
were in the top quarter or bottom quarter of the distribution for all the 
students who had achieved higher than the mean in mathematics Eighty-two 
students (high confidence girls, low confidence girls, high confidence boys, 
and low confidence boys) were observed daily in their reguxar mathematics classes 

for 3-4 weeks during the spring semester of 1980 and again in 1 981. Betwe en 

three and fourteen students (i.e*, target students) were observed in^earh 
mathematics class. 

Two carefully trained observers recorded data on target student and 
teacher behavior in each classroom. One observer recorded characteristics of 
interactions between the teacher and individual target students. The second 
observer recorded engagement in mathematics and cognitive level of learning 
activities in which students were engaged. Data were collapsed across class- 
rooms and analyzed using Analysis of Variance technique with sex, confidence 
level, and year as factors. 

vi 
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Introduction 

That women are under-represented in occupations related to mathematics 
is an assertion that needs no support. Hypotheses as to why this occurs 
range from genetic differences between the sexes which limit females' ability 
to learn mathematics, to overt discrimination which limits females' employ- 
ment opportunities. Neither type of hypothesis is particularly helpful in 
understanding why women are under-represented in mathematics-related occupa- 
tions or in increasing the representation. Even if the genetic hypothesis 
has validity (which many doubt, [Nelson, 1977; Sherman, 1977]), the number 
of women now in careers related to mathematics is less than that which could 
be explained by any genetic^dif f erences . The overt discrimination hypothe- 
sis does not consider that adult females have less knowledge and fewer 
skills in mathematics than do adult males (as clearly indicated by the National 
Assessment of Educational Progress results [Muxiis, 1975]). Until adult 
females' mathematical knowledge and skills are equivalent to those of adult 
males, unequal representation of the Sexes itr occupations related to mathe — 
matics will continue. Therefore, the major problem facing those concerned 
with equity in this area is ensuring that females acquire mathematical 
skills and knowledge equivalent to those acquired ~by males. In order to do 
this, knowledge about why fe 1 es have not learned mathematics to the degree 
that males have is essential. 

Although simplistic to state, this is not a simple problem. Involved 
in it is the cognitive acquisition of mathematics by females, as well as 
the attitudes or affective beliefs held by females, male peers, parents, 
and educators toward females as learners of mathematics. The cognitive and 
affective components are so intertwined that it is difficult, if not impossible, 
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to separate them. Not only are they intertwined, but they are developed 
over a period of years in a complex social matrix which involves home, 
community, and school. One approach to follow in seeking to understand why 
inequity exists in the representation of the sexes in occupations related 
to mathematics is to focus attention on one important dimension in one part 
of this complex social matrix. Thus, the focus of this study was investiga- 
tion of the development of sex-related differences in confidence in learning 
mathematics in the mathematics classroom and the influence of confidence on 
mathematics classroom participation. 

The major questions addressed were: 

1. Are there sex-related differences in participation in selected 
classroom processes? 

2. Do girls and boys of different confidence levels participate 
differently in classroom processes? 

3. Does the participation in classroom processes of girls and boys 
of different confidence levels change over time? 

Review of Literature 
Sejc-Rela^ed_ Dif f erences in Mathematics 

In 1981, Fe-nnema ended an overview of women and mathematics with the 

f<> I loving conclusions: 

1. There are still sex-related differences in electing to study 

mathematics in high school. While not as dramatic as were once 
suggested, females tend not to study, as much as do males, the 
most advanced mathematics courses and courses peripheral to math, 
such as computer science, statistics, and physics. It appears that 
the size of the differences varies tremendously by school and by 
. region of country. At the post high school levels, differences 
are still large. 
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2. Even when amount of mathematics studied is controlled, females 
appear not to be learning math as well as are males in some in- 
stances. This trend should be of concern to all. When 
females excel, it is in lower level cognitive tasks. Even 
when females and males report they have been enrolled in 

the same mathematics courses, males perform better .on more 
difficult and complex tasks. 

3. There are psychological variables which may help in understand- 
ing sex-related differences, females, as a group, more than 
males as a group, have less confidence in learning mathematics,* 
perceive mathematics to be less useful to them, and attribute 
successes and failures in mathematics differently. 

4. Males perform better than females on tests of spatial visuali- 
zation although the impact of spatial visualization on the 
learning of mathematics is largely unknown. 

5. Classroom learning environments are different for females and 
males in a variety of ways.* 

Of the few studies which have specifically investigated sex-related 
differences in one classroom process, i.e., engaged time, only one has indi- 
cated a difference between^f emales and males, and this fXxxdy (Yeger & Miezitis, 
1980) found females engaged a higher percentage of the time than males. The 
literature does indicate differences in the number of interactions that occur 
between teachers and males and teachers and females, with males generally 
involved in more of some types of interactions than females. 

What has the literature shown concerning high and low confidence 
students' participation in mathematics processes? Confidence in mathematics 
is an important variable in that it is correlated positively with student 
achievement and enrollment in mathematics courses, but is it one of the 
student characteristics which is related to classroom processes? Two studies 



*For a complete review of literature on confidence in learning mathematics, 
and classroom learning environments, see Reyes, L.H. Classroom processes, 
sex of student, and confidence in learning mathematics. Unpublished doctoral 
dissertation, University of Wisconsin, 1981. 
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were found which investigated classroom behaviors of high and low self- 
concept students (Shiffler et ai., 1977; Yegei: & Miezitis, 1980) but neither 
of these was concerned with mathematics classrooms. Both studies found low 
self-concept students off-task a greater percentage of the time that* self- 
concept students. Yeger and Miezitis found differences in teacher-student , 
interactions between high and low self-concept students with high self- 
concept students involved in more interactions with teachers and with peers 
than low self-concept students. Thus, answering yes to the second question — 
Do students with different levels of confidence in themselves as learners of 
mathematics participate differently in Mathematics classroom processes? — 
receives some support. 

Little information is available about change in participation in class- 
room processes over time. 

The Study 

Sample . • 

The sample consisted of 80 girls and boys who* were in the 7th grade in 
Year I of the study and 8th grade in Year II. During the spring of 1979, 
all sixth grade students in four middle schools in * midwestern city were 
given the Mathematics Concept subtest of the Science Research Associates 
(Naslund, Thorpe, and LeFever, 1971) and four scales of the Fehnema- Sherman 
(1976) Mathematics Attitude Scales (Confidence in Learning Mathematics, 
Usefulness of Mathematics, Teacher, Math as a Male Domain). 

The sample for the study consisted of approximately equal numbers of 
girls and boys who scored at or above the mean on the test of ^mathematics 
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achievement, and who were in the top quarter or bottom quarter of the dis- 
tribution of confidence scores. Means and standard deviations for the four 
sample groups for mathematics achievement and confidence in mathematics are 
shown in Table 1. To test for differences between the sample groups on 
confidence in mathematics scores and mathematics achievement scores, analyse: 
of variance were done using sex and confidence group as the factors, and the 
results are reported in Tables 2 and 3. While girls and boys did not differ 
significantly, the mathematics achievement mean for high confidence students 
was higher than the mathematics 'achievement mean for low confidence students 
There was a statistically significant difference in reported confidence in 
mathematics between the high, arid low confidence groups, as desired, and no 
statistically significant difference between girls and boys. 

Table 1 

Means, Standard Deviations, and n * s for Mathematics 
Achievement and Confidence by Sample Group 



* Mathematics Con-f idence 

Achievem ent in Mathematics 

n 

Girls 

High Confidence 20 ^ 

Low Confidence- 25 

i Boys 
High Confidence 24 
Low Confidence 24 

a Naslund, Thorpe, & LeFever, 1971; D Fennema & Sherman, 1976. 



Mean S.D. 

30.5 3.3* 

27.1 4.1 

30,0 3,6 

27.3 3.6 



Mean S.D. 

56.7 2.6 
38.4 4.6 

56.8 2.2 

3fc.l 5.0 



Table 2 

ANOVA for Confidence in Mathematics 





by Sex and 


Confidence 


Level 








for 


Sample Grou 


P 






Source 


SS 


df 


MS 


F 


P 


Sex 


30.15 


1 


30.15 


2.06 


.16 


Confidence Level 


8870. 53 


1 


887C.53 


604.91 


.00** 


Sex X Coi idence Level 


33.51 


1 


33.51 


2.29 


.13 


Within Cell 


1305.13 


89 


14.66 







**p <^.01 



Table 3 

ANOVA for Mathematics Achievement by 
Sex and Confidence Level 
for Sample Group 



s5u7ce~~ ' SS df MS_ F E 

Sex 0.23 1 0.23 .02 .90 

Confidence Level 206.01 1 206.01 15.09 .00** 

Sex X Confidence Level 2.54 ,1 '2.54 .19 .67 

Within Cell 1214.92 89 13.65 
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**p < .01 

Subjects were located in 12 different mathematics classes taught by 
six teachers during Year I and in 11 mathematics classes of seven teachers 
during Year II. Table 4 shows the sample by school, classroom, group and 
year . 

O bservation Instruments 

Teacher-Student Interaction 

Several categories of interactions were identified to be observed: 
context of interaction (public or private), initiator of interaction (teacher 
or pupil), student did or did not volunteer to interact, cognitive level » 
of the interaction, interaction concerned with student work or conduct, and 
teacher feedback. The Brophy-Good Dyadic Observation System (Brophy & Good, 
1970) which focuses on teacher 'interactions with individual students, was 
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Table 4 

Number in Each School, Classroom, and Group 
Year I 



Girls 



Boys 



Teacher- 


High 


Low 


High 


Low 


Classroom Confidence 


Confidence - , 


Confidence 


Confidence 












I-l-A 


2 


3 


0 


2 


I-2-A 


3 


1 


2 


1 


I-3-A 


3 


1 


5 


1 


I-3-B 


3 


2 


1 


2 


I-3-C 


0 


2 


2 


4 


I-4-A 


1 


3 


3 


3 


I-4-B 


0 


3 


1 


4 


I- 5- A 


2 


2 


4 


2 


I-5-B 


1 


2 


0 


2 


I-6-A 


2 


3 


1 


2 


I-6-B 


1 


2 


2 


0 


I-6-C 


2 


1 


3 


1 


All Classrooms 


20 


25 


24 


24 


Year II 


II-l-A 


2 


2 


3 


0 


II-2-A 


4 


0 


3 


2 


II-3-A 


0 


3 


0 


0 


II-3-B 


1 


1 


0 


1 


II-4-A 


1 


0 


0 


3 


II-4-B 


2 


1 


2 


'. \ 


II-5-A 


4 


1 


4 


II-6-A 


1 


5 


2 


3 


II-6-B 


2 


1 


2 


0 


II-7-A 


1 


1 


3 


4 


II-7-B 


2 


5 , • 


3 


3 


All Classrooms' 










ERIC 


m • 






* • * 



8 



modified to incorporate the categories above. A more detailed description 
of the observation system is in the Observer Manual in Appendix A. 

In this instrument, as interactions occur they are recorded on a data 
sheet designed to be scanned by machine. The data sheet has a space to 
mark indicating which target student was involved in each interaction and 
spaces to mark to describe the interaction (e.g. Public or Private, Student 
Initiator, Teacher Initiator, etc.). A copy of the data sheet is in 
Appendix B . 

The listing of teacher-student i teraction observation categories are 
in Table 5, and fit into three broad categories: (1) public interactions, 
(b) private interactions, and (c) teacher comments. Public interactions 
occur when the attention of the class is on the teacher and on the interaction. 
Private interactions occur when the attention of the class is not on the inter- 
action. Generally, public interactions happen during class discussion and 
large group teaching, while private interactions happen during times when 
students are involved in individual seatwork. 

Engaged Time 

Data concerning target students' engaged time in mathematics and three 
characteristics of the learning tasks in which they were engaged were collec- 
ted using a coding system adapted from one developed by Romberg, Small, 
Carnahan, and Cookson (Note 8). The system uses a time sampling procedure 
which consists of a schedule for rotating the observation of each target 
student in the class, allowing 30 seconds per student. During the 30 seconds 
allowed, the first 20 seconds are used by the observer to get ready to record 
the behaviors of the student at the 20th second, or sampled moment, of the 
30 second period. Seconds 21 through 30 of the 30 second period are used to 
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Table 5 

Teacher-Studont Interaction Observation Categories 



Public 



Initiator 

Teacher 
Student 
Response Opportunity 

Discipline Question 
Direct-No Volunteer 
Open-Volunteer 
Callout 
Level of Question 
Higher Level 
Lower Level 
Non-Ma t hema tics 
Student Answer 
Correct 
Part Correct 
Incorrect 
No Response 
Teacher Feedback 
\ Positive 



\ 



Neutral 

Negative 

Sustaining 



Interactions 



Private 



Student-Initiated Work 
Praise 

Higher Level 

Lower Level 

Criticism 

Don't Know 
Student-Initiated Procedural 

Praise 

Neutral 

Criticism 
Teacher-Initiated Work 

Praise 

Higher Level 

Lower Level 

Criticism 

Don't Know 
Teacher-Initiated Procedural 

All 



Public or Private Interactions 



Teacher-Initiated Behavioral 
Praise 
Criticism 



Rir 



1 n 
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record the proper codes which describe the behavior of the target student 
at the sampled moment. The observation in a specified order of all target 
students in a class followed by a 30 second rest period was called a cycle. 
After each five cycles, observers take a one-minute break. These observa- 
tions are recorded on a machine scanned coding sheet (Appendix A) • The 
observer manual (Appendix A) contains greater detail. The engaged time ob- 
servation categories were: (a) Absent, (b) Engaged or non-engaged in mathe- 
matics, (c) High or Low cognitive level, (d) Spatial or non-spatial, and 
(e) Peer or non-peer. 

Data Collection 

Observer Training 

Observers were caiefully selected and trained prior to gathering both 
the Year I and Year II data. They were paid for training as well as obser- 
vation time lach teacher-student interaction and engaged time observer 
had had classroom teaching experience. 

The teacher-student interaction observers were trained each year during 
a two week block in daily two hour sessions. The first three days were spent 
understanding the categories of the coding system and practicing the use 
of categories on transcripts and videotapes of 7th grade mathematics classes. 
The remaining days were spent practicing the coding system in actual middle 
school mathematics classes not in the study. On the first day of training, 
the study was described to the observers. To avoid giving observers reason 
to have any expectations of how certain students might act, the procedure 
of the study was explained, but the hypotheses and questions for the study 
were not given. Neither were the criteria given for the selection f the 
sample. Observer manuals and machine readable data sheets were handed out 
and described in general* The public categories of the teacher-student 
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interaction coding system were described in detail, including the defini- 
tions of the categories and the rules used in distinguishing one category 
from another. The remainder of the day was spent practicing the coding 
system on interactions available from a transcript of a seventh grade mathe- 
matics class. Observers were asked to read the observer manual by the next 
day . 

The second day of teacher-student interaction observer training began 
with discussion of the public categories introduced the previous day. 
Questions that arose from the reading of the manual were also discussed. 
More time was spent practicing coding with the transcript of the seventh 
grade mathematics class. Next, observers attempted to record the teacher- 
student interaction from a videotape of a seventh grade mathematics class* 
Coding of both the transcription and the videotape allowed plenty of 
opportunity to present examples of categories and discuss distinctions between 
categories. The rest of the time was spent describing the categories for 
.teachers' comments and how to record the occurrence of the teacher behaviors 
of interest in these categories. 

The third day of training began with discussion of questions from the 
work done on the first and second days of training, and the private categor- 
ies were explained in detail. The majority of the time on day three was 
spent practicing" the entire coding system with videotapes of a seventh grade 
mathematics class. 

The remaining days of training were spent practicing the observation 
system in middle school mathematics classes. Each day, a similar routine 
was followed. Observers^ met before the beginning of the class to discuss 
any questions about observation categories. All the observers then sat in 
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the back of the classroom, identified (among the observers only) which 
students would be observed, and coded all of the teacher-target student 
interactions for most of the class period. After tfte class ended, or 
after the observers had coded sufficient interactions for the day, all 
of the observers left the classroom and spent time comparing their coding 
of the classroom interactions- In this way, observers learned the coding 
system, obtained practice using the system, and became accustomed to being 
in middle school mathematics classes. Training was continued for each ob- 
server until their percent agreement with the researcher was at least 70 
percent in each category. 

Both years, the engaged time observers were also trained in daily two- 
hour sessions which met separately from the teacher-student interaction 
observation training- First, the study was described in similar detail as 
had been used with the teacher-student interaction observers. The procedure 
for the study was described. However, neither the purpose of the study nor 
the method used in selecting the sample were explained to the observers. 
The method of time sampling was described in detail. Copies of the machine 
scorable data sheet were handed out and the different sections of the form 
were described. The time sampling procedure was explained with a demonstra- 
tion of the actual timing. The categories were described along with the 
method to use in filling in the coding sheet. The observers practiced the 
engaged time- observation system by coding portions of videotape of a seventh 
grade mathematics class. Each observer received a training manual and was 
asked to read the manual before the next day. 

The second day of engaged time observer training began with a review and 
discussion of the time sampling procedure and the observation categories. 



Most of the session was spent practicing the system by coding videotapes of 
a mathematics class. Subsequent training sessions were conducted in schools 
practicing the engaged time observation live in sixth and seventh grade 
mathematics classes. These sessions included detailed discussions of the 
distinctions between categories. After two of classroom practice, the percent 
agreement between each observer and the researcher was checked. Training 
continued until each observer reached at least 70 percent agreement with a 
criterion observer for each category. 
Data Collection 

It was planned that all Year I observation data would be gathered 
between January 7, 1980 and February 29, 1980. Six -lasses were to be 
observed during the four weeks from January 7 to February 1, and the remaining 
six classes were to be observed from February 4 to February 29. Six classes 
were observed as planned beginning January 7. During the week of January 28, 
one teacher to be observed beginning February 4 gave notice of his resigna- 
tion to be effective on February 4. Thus, only three classes were observed 
from February 4 to February 29. The observation of the other three classes 
was postponed for four weeks until March 3 to March 28. During Year II, six 
classes were observed January 19-February 13, 1981, and five classes were 
observed February L6-March 12, 1981. 

Observer Agreement 

Teacher-Student Interaction 

Percent agreement for each observation category was obtained between 
each observer and a criterion observer before data collection to determine 
that observers had learned the system adequately and during data collection 
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to ensure that observers hi 4 maintained their accurate use of the coding 
system. To check agreement the observer and criterion observer coded the 
same students ^.nd teacher at the same time in a middle school mathematics 
classroom. 

Once the classroom had been coded, the observer's data were compared 
to that of the criterion observer. The first step consisted of checking 
what percent of the total number. of interactions coded by the criterion 
observer were also coded by the observer. This was computed as number of 

agreements divided by total number of interactions coded times 100. This 

f 

is the percent agreement for identification of interactions. Next, a compari- 
son was made in each observation category between observer and criterion 
observer for all the interactions which had been identified by both observer 
and criterion observer. For each observation category, the number of agree- 
ments divided by agreements plus disagreements multiplied by 100 yielded 
percent agreemenc for the category. For Year I, all observation category 
agreement checks for interactions which occurred frequently was higher than 
78?;. Complete data on Observer Agreement are in Appendix C. 
E ngaged Time 

Percent agreement between individual observers and a criterion observer 
was also obtained for engaged time observation categories. As for teacher- 
student interaction agreement checks were used during training to determine 
when observers had learned the coding system well enough to collect data and 
during data collection to be certain that observers maintained a high level 
of accuracy. To check agreement, the observer and criterion coded a class- 
room together observing the same students at the same moments. 
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After coding, the data of the observer were compared to that of the 
criterion for each category. Percent agreement in each category was deter- 
mined by dividing the number of cycles across students with agreement by 
the number of agreements plus disagreements multiplied by 100. All agree- 
ments for each engaged time observation category were greater than 56% with 
the exception of one category (Complete data are in AppendixC). 
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Data Analyses and Results 
T eacher-Student Interactions 

Data sheets marked by observers were checked soon after the collec- 
tion of data to be sure that observers were using correct procedures. 
When all data had been collected, sheets were checked agoin to ensure that 
teacher, student, and observer identification numbers were accurately 
recorded. The data sheets were then machine read by an optical scanner 
at Wisconsin Testing and Evaluation and the data were placed on computer 
tape. 

The data for all categories were first recorded so that the interac- 
tions for target students for each observation day were in the order 
the interactions had occurred in the classroom. The data were then reor- 
ganized in a computer file so that for each public and private observation 
category, a mean frequency per day for each student could be calculated. 
These values were produced by summing an individual target student's raw 
frequencies for each public and private observation category across days 
and dividing by the number of days that student was observed. Group 
means and standard deviations were formed for the various sample groups by 
using the mean frequency per day values. 

Thes- means and standar' deviations for Public Interaction Categories 
by sex, confidence level, and year are in Table 6. Similar statistics 
for Private Interaction Categories are in Table 7. Two way analysis of 
variance were done for each observation category using sex, confidence level, 
and year as factors and the resulting F-ratios, degrees of freedom, and 
probability levels are in Tables 8 and 9. 
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Table 6 



Means and Standard Deviations of Frequencies per Day for Public Teacher-Student 
Interaction Categories by Sex, Confidence Level, and Year 



YEAR I YEAR 11 
Girls Boys _ Girls Boys 



High 3 Low b ' High° Low d High 3 Low High Low 
Conf idence Confidence Confidence Confidence Confidence Confidence Confidence Confidence 
( S d) x (sd) x (sd) x (3d) x ( sd) x (sd) x (sd) x (sd)_ 



Total Interactions 

Public 1.05 

Initiator 

Teacher .93 

Student .11 

Response Opportunity 

Discipline Question .01 
Direct-No Volunteer -37 

Open Volunteer .42 

Callout .06 

Level of Question 

Higher Level .14 

Lower Level .86 

Non-Mathematics .05 

Student Answer 

Correct .72 

Part Correct .08 

Incorrect .09 

No Response .04 

Teacher Feedback 
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Neutral .76 

Negative .11 

Sustaining . 21 
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Means and Standard Deviations of Frequencies per day 
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Interaction Categories by Sex, 


Confidence 


Level 


, and Year 




















YEAR 


I 




























Girls 






Boys 








Girls 






Boy 
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Confidence 
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(sd) 
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(sd) 
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X 
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Total Interactions 
































Private 
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(.47) 


.66 


(.52) 


.94 


(.86) 
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1.46 
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1.46 


(1.08) 
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Table 8 

F-ratios and Probability Levels from ANOVAs by Sex, Confidence Level, and 
Year for Public Teacher-Student Interaction Categories 



Category 



Sex a 



Confidence^ 



Year c 



sxc^ 



sxy' 



cxy* 



sxcxyS 

F P 



Total Interactions 

Public 
Initiator 

Teacher 

Student 
Response Opportunity 

Discipline Question 

Direct-No Volunteer 



5.19 

5.36 
3.A8 

A. 13 
.14 



.03* 

.02* 
.07 

.05* 
.71 



.10 

.26 
.00 

1.10 
3.28 



,76 41.45 



.00** .79 



38 1.6A 



.61 
.99 

.30 
.07 



57.03 
1.70 

.24 
23.81 



,00** 
.20 

.63 
.00** 



.OA 
2.33 

.59 
2.18 



.83 
.13 

.45 
.15 



1.83 
.23 

.84 
.00 



.21 

.18 
.63 

.36 
.96 



Open Volunteer 


5. 


60 


.02* 


.20 


.66 


41. 


12 


.00** 


.94 


.34 


4.81 


.03* 


Callout 


A. 


79 


.03* 


.00 


.96 


.51 


.48 


2.11 


.15 


.60 


.44 


Level of Question 


























Higher Level 


l. 


18 


.14 


.03 


.86 


3.80 


.06 


1.34 


.25 


.98 


.33 


Lower Level 


5. 


23 


.03* 


.00 


.99 


48. 


35 


.00** 


.31 


.58 


1.01 


.32 


Non-Mathematics 


3. 


8A 


.05* 


1.29 


.26 


.83 


.37 


1.29 


.26 


.20 


.66 


Student Answer 


























Correct 


3. 


72 


.06 


.13 


.72 


49. 


Al 


.00** 


.03 


.86 


.44 


.51 


Part Correct 


3. 


96 


.05* 


.66 


.42 


23. 


52 


.00** 


.00 


.99 


1.61 


.21 


Incorrect 


7. 


60 


.01** 


.04 


.85 


It. 


AA 


.00** 


.19 


.66 


.72 


.40 


No Response 


1. 


30 


.26 


.08 


.78 


2.78 


.10 


.78 


.38 


3.64 


.06 


Teacher Feedback 






















.14 


.71 


Positive 


A 


Al 


.04 


.07 


.79 


25. 


88 


.00** 


.23 


.63 


Neutral 


A. 


13 


.05 


.50 


.48 


A8. 


31 


.00** 


1.33 


.25 


2.14 


.15 


Negative 


5 


67 


.02 


.00 


.99 


11. 


26 


.00** 


.28 


.60 


.31 


.58 


Sustaining 


3 


31 


.07 


.27 


.61 


23. 


69 


.00** 


.03 


.86 


1.87 


.18 


a df(l,78), b df(l,78), 


C df(l,78), 


d df(l,78), 


8 df(l, 


78), f 


df (1, 


78), 


g df(l,78), * P 


< .05, 


**p < 


.01 



.91 

1.36 
.01 

.08 
1.70 
.29 
.14 

.03 

1.61 

.15 

1.35 
.35 
.04 
.11 

2.79 
.60 
.45 
.13 



.34 

.25 
.94 

.78 
.20 
.59 
.71 

.87 
.21 
.70 

.25 
.55 
.84 
.74 

.10 
.44 
.51 
.72 



.67 

1.06 
.00 

2.43 
3.02 
.37 
.00 

1.03 
1.24 
.93 

1.09 
.07 
.56 
.39 

.01 
1.91 
.17 
.04 



,41 

.31 
.95 

.12 
.09 
.55 
.97 

.31 
.27 
.34 

.30 
.80 
.46 
.53 

.94 
.17 
.68 
.84 
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Table 9 



F-ratios and Probability Levels from ANOVAs by Sex, Confidence Level, and 
Year for Private Teacher-Student Interaction Categories 



Category 


Sex a 




Confidence' 3 


Vpor C 
I Cdl 




d 

sxc 




e 

sxy 




f 

cxy 




o v r* w 


g 




F 


P 


F 


P 


F 


P 




n 

P 


F 


P 


V 

L 


p 


p 


p 


Total Interactions 




























Private 


.03 


.87 


. ol 


. JO 


30.88 


.00** 


.48 


.49 


1.30 


.26 


.39 


.53 


.22 


.64 


Initiator 






























Teacher 


.03 


.86 


C\C\ 

. uu 


. y j 


9.96 


.00** 


.88 


.35 


.03 


.87 


.04 


.85 


.00 


.99 


Student 


.06 


.81 


A 7 


. jU 


31.25 


.00** 


.33 


.57 


2.12 


.15 


.44 


.51 


.32 


.57 


Student- Initiated 


Work 




























Praise 


.19 


.66 




r\ q 
. Uo 


3.00 


.09 


.08 


.78 


4.02 


.05* 


1.60 


.21 


.78 


.38 


Higher Level 


.23 


.63 


.04 


.85 


17.61 


.00** 


.14 


.71 


.56 


.46 


.00 


.99 


.00 


.97 


Lower Level 


.11 


.75 


.16 


.69 


30.77 






.69 


.46 


.50 


.87 


.35 


.57 


.45 


Criticism 


1.22 


.27 


.44 


.51 


2.84 




^.73 


.40 


.01 


.92 


.16 


.69 


2.52 


.12 


Don't Know 


.11 


.74 


1.44 


.23 


.25 


.62 


.15 


1.16 


.29 


.96 


.33 


.09 


.77 


Student-Initiated 


Procedural 




























Praise 


1.98 


.16 


.83 


.36 


.94 


.34 


.33 


.57 


.41 


.52 


1.71 


.20 


.01 


.91 


Neutral 


.01 


.93 


4.01 


.05* 


5.14 


.03* 


.52 


.47 


3.76 


.06 


.35 


.55 


-21 


.65 


Criticism 


6.74 


.01** 


.49 


.49 


.04 


.84 


.08 


.78 


.01 


.92 


1.67 


.20 


.73 


.40 


Teacher- Initiated 


Procedural 




























All 


.21 


.65 


.17 


.68 


15.97 


.00** 


1.37 


.24 


.37 


.54 


.08 


.77 


1.42 


.24 



a df(l,78), b df(l,78), C df(l,78), d df(l,78), e df(l,78), f df(l,78), 8 df (1, 78)'; % < .05, **p < .01 
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Several things are quickly apparent from an inspection of Tables 6-9. 
There are many significant sex differences in the mean frequency per day 
of Public Teacher-Student Interactions with boys participating in many 
more interactions with teachers than do girls (Total Interactions). Teach- 
ers initiate more interactions with boys, (significant at .05 level), ask 
boys more questions for discipline purposes, ask boys more higher, lower, 
and more non-ma themat ics questions. Boys appear to be more active initia- 
tors of interactions. They volunteer more to answer questions and to call 
out responses without waiting for teacher recognition. 

These observed patterns of behavior were seen during both years. 
Although many significant year affects were found which indicate that 7th 
and 8th grade teachers interact with students differently, no significant 
sex x year interactions were found. No significant effects for confidence 
Level were found. 

The same pattern of sex-related differences on teacher-pupil interac- 
tions for private interactions was not observed. Once again, significant 
effects for year were found, but few significant effects for sex or confi- 
dence level were seen. 

Since this was a true longitudinal study with the same subjects being 
observed both years, the plots of the group means give added insight to 
the statistical analyses* Figure 1 shows clearly that both groups of boys 
participated in more interactions than did either group of girls and Figure 
3hows the same for Public Interactions. In both cases, the High Confidence 
females are participating in the fewest interactions and High Confidence 
males are participating in the most. Few differences are seen in number 
of Private Interactions (Figure 3). 

*Plots are found in text or in Appendices D & E. 
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Another interesting way of looking at overall interactions is to 
inspect the number of days tfith No Interactions. Keep in mind that these 
groups of students were observed each year 15-20 days. Figure 4 shows 
that both years, low confidence girls did not participate in any interac- 
tion^^nore often than any other group with low confidence boys the next 
/ highest group both years. Both groups of girls participated in no public 
interactions about 50% of the observational days. Low confidence girls 
and boys did not interact with the teacher privately as often as did high 
confidence students. 

The question that a*, ays comes to mind as one studies teacher/pupil 
interactions is direction of causation. Is the teacher the one who is 
dominant in determining who s/he interacts with, or is the teacher only 
a reactor and the students determine who s/he interacts with, of course, 
neither teacher nor student is always the reason for all interactions 
and each contributes causation. However, it is interesting to break down 
the data in such a way that some information can be gained about teacher 
behavior and student behavior. 
Teacher Behavior 

The plots of means help in describing teachers' behaviors. Teachers 
initiate more public interactions with boys than with girls (Figure 7), 
but about the same number of private interactions with girls and boys 
(Figure 8). Teachers asked boys more non-academic questions (Figure 9) 
and more low level questions (Figure 10). High confidence boys were 
asked more high level questions than any other group (Figure 11) . One 
other thing should be noted. High Co. _dence girls often participate in 
fewer interactions than any other group (Total Interactions, Public Inter- 
actions, Private Initiated by Teacher, Non-academic Question, Low Level 
Questions, and High Level Questions). 
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Teachers do tend to directly call on High Confidence Level Girls 
slightly more than other groups and Low Confidence Girls less than other 
groups (Figure 12). Teachers initiated contacts with boys more than girls 
for discipline reasons (Figure 13). Teachers also called on boys more 
when they had their hands up to respond to a question (Figure 14). 
Teachers responded to call outs by boys more often than they did to girls 
(Figure 15). These latter two may have been due to the boys' behavior 
more than to the teachers, however, with boys calling out and raising their 
hands in response to a question more than did girls. 

It appears clear from inspecting these two year plots and the results 
of the ANOVAs that teachers are not only interacting significantly more 
with boys, but are also initiating more interactions with boys than with 
girls. While girls are receiving more equitable treatment privately than 
they do publically, overall girls are receiving less attention from teachers 
than are boys. Teachers do seem to be adjusting their behavior to the 
confidence level of girls to some extent. While they do not interac 
puhlxcaliy with luw confidence girls as much as with other groups (Figure 5) 
and initiate the fewest public interactions with this group (Figure 7), 
the days with no private interactions (Figure 6) and the private inter- 
actions initiated by the teacher (Figure 8) show few differences by group. 

Understanding how a teacher responds to children is almost impossible 
with these data because the number of times a teacher gives feedback is 
related to the number of interactions that occur. While boys received 
more positive, neucral, sustaining and negative feedback than did girls, 
they also participated in more interactions that required feedback. (See 
Appendix E for these plots.) 
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Table 10 



Means and Standard Deviations of Percent of Time Engaged 
by Sex, Confidence Level, and Year* 



Year I Year II 

Girls Boys Girls Boys 

Category High 1qw High Low High Low High Low 

x(sd) x(sd) x(sd) x(sd) x(sd) x(sd) x(sd) x(sd) 



Engaged 66.60 64.13 66.40 59.43 67.06 66.91 68.57 65.14 

(8.34) (8.21) (7.94) (10.54) (9.12) (6.67) (6.59) (9.43) 

High Level 22.55 21.38 18.24 19.98 20.09 17.12 21.23 18.56 

(16.67) (14.02) (12.30) (13.51) (9.79) (5.93) (6.39) (8.04) 

Spatial 14.25 25.88 21.97 19.93 31.01 47.46 34.87 46.83 

(13.47) (15.78) (17.62) (18.36) (26.73) (22.17) (28.94) (24.64) 

3.68 4.89 3.04 4.69 8.98 8.96 5.06 5.65 

(2.98) (6.02) (3.16) (4.32) (9.83) (12.17) (3.56) (5.48) 



Peer 



n " V To" i n each group : High confidence girls, low confidence girls, low 

confidence boys 
n = 22: High confidence boys 



Table 11 



F-ratios and Probability Levels from ANOVAs: Sex, 
Confidence Level, and Year for Engaged Time Categories* 



Category Sex p Confidence p Year p SxC p SxY p SxCxY 



n 1 



Engaged .74 .39 4.72 .03* 6.33 .01 1.68 .20 1.11 .30 .08 .78 

High Level .20 .66 .52 .47 .51 .48 .21 .65 1.32 .25 .13 .7 

Spatial .08 .77 4.79 .03* 94.39 .00 1.09 .30 .03 .86 1.30 .26 

Peer 3.55 .06 .64 .43 9.40 .00 .06 .81 2.50 .12 .00 .97 

*df"= T,"78 ~ ~ ~ 



ERIC 



45 



Student Behaviors 

There is evidence that boys initiate more public interactions than do 
girls (Figure 16). However, an interesting finding is that while high 
confidence boys initiate more interactions than any other group, high 
confidence girls initiate the fewest. Figure 17 indicates that all girls 
initiated more private interactions in the 8th grade than in the 7th, so 
by 8th grade girls appeared to be demanding more teacher time. The low 
confidence girls, however, appear to be demanding more teacher time in 
low level interactions (Figure 18). Very few differences were found 
between groups in the number of high level interactions initiated by 
students (Figure 19). 
Engaged Time 

The data sheets marked by observers were checked carefully before 
being read by the optical scanner at Wisconsin Testing and Evaluation. 
Data were placed on a preliminary computer tape. Upon examination of the 
listing of the data, certain small errors were found, such as omission of 
observer or teacher identification numbers, and date of observation. 
These errors were easily corrected. After correcting the errors, Wisconsin 
Testing and Evaluation produced the complete data tape. 

The data on tape were then reorganized so that for each student, each 
variable from each cycle was recorded separately. A daily percent was cal- 
culated for each student for each day for each variable. Each student's 
daily percents were then summed and divided by the number of days that 
student was observed to form a mean percent per day. The variables thus 
formed were: (a) mean percent of cycles engaged in mathematics (Engaged 
Cycles) and (b) mean percent of cycles engaged in mathematics where subject 
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was working on a higher cognitive level task (Higher Level Cycles). For 
these variables, the mean percent per day values for students were summed 
within group and then divided by the number of students in the group to 
form group means. These means and standard deviations are in Table 10 
and F ratios found from ANOVAs computed with them are in Table 11. The 
plots of the various categories of Engaged Time are shown in Figures 20-23. 
No significant sex differences were found although girls were engaged more 
with peers than were boys (p=.06). Low confidence students were engaged 
significantly more in spatial activities *:han were high confidence students- 

Conclusions and Discussion 

Three major questions were addressed in this study and each will be 
discussed separately. 

1. Are there sex-related differences in participation in 
selected classroom processes? 

the answer to this question is yes. Boys in the 7th and 8th grades 
do partiripate in more teacher/student interaction than do girls. Teachers 
initiate more interactions with hoys than with girls, discipline boys more 
and ask bo;/55 more questions. Boys also initiate more interactions with 
teachers tlian do girls. Host of these sey-related differences appear in 
Public Interactions, i.e., when the teacher is interacting in a group 
SC J on . 

Roys and girl s are not engaged in different activities during mathe- 
matics classes, however. TW*y were working on mathematics about the same 
perut-nta^e of time, and they were working with high level and spatial 
tasko about the same percentage of time. 
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2. Do girls and boys of different cdnfidence levels 
participate differently in classroom processes? 

The answer to this question is sometimes. Both girls and boys of 
low confidence levels engage in more spatial activities. High confidence 
boys participate in more interactions than any other group while high confi- 
dence girls participate particularly in public interact ious less than any 
other group. These high confidence girls- -more than any other group — don 1 t 
interact with the teacher at all on many days. 

It is in the public interactions where the largest differences are 
found. There are fewer teacher/girl than teacher/boy interactions. Why 
is this? This etudy doesn't tell us why but some Speculations are in order. 
Keep in mind the age of these students at the beginning of adolescence and 
the fact that they are above the means of their group in mathematics achieve- 
ment. Did those girls hesitate to initiate interactions because they are 
becoming increasingly concerned with their sex identity and feel that they 
were less feminine if they appeared in their peers 1 eyes to be succeeding 
in mathematics? Were the teachers also indicating a belief that mathematics 
was more important to boys than to girls? 

3. Does the participation in classroom processes change 
over time? 

The answer to this is— in some cases yes — and in some cases no. 
While overall sex differences emerged both years, no consistent trend 
could be found. 

One other major conclusion must be drawn from this studv. While the 
-ex differences found were pervasive - cutting across 19 classrooms and 
2 years of study, they were also not as dramatic as the literature would 
lead one to believe. The differences found were subtle, found only after 
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thrue or more weeks of observation and in many cases differences were not- 
found at all. The problem of causation of sex-related differences in 
mathematics is not easily identified* Blatant sexism did not exist, except 
very occasionally, in the classrooms. Too much rhetoric and literature 
overgeneralizes results that are found. We must cease doing this. 

Several avenues of promise for future investigation emerged from 
this study. Differences between high md lew confidence girls and boys 
should be explored further. 

An in depth study of differences between high and low confidence 
girls might give specific direction for interventions. Would high 
confidence girls profit from assertiveness training that would permit 
them to receive equitable treatment from teachers? Would low confidence 
girls profit more from interventions of a different type? 

The relationship found between participation in spatial activities 
and low confidence learners needs further exploration, Are these low 
confidence girJs and boys becoming loo dependent on such activities and 
not relvim; on activities of a more abstract nature? Does this inhibit 
Learning in mathematics? 

rut ure studies of sex-related differences in classroom processes 
should utilize other processes than the ones observed in this study- 
Perhaps more dramatic differences will be found that will further con- ^ 
rriDnte to our knowledge of sex-related differences in mathematics. 
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PREFACE 

A middle school mathematics classroom contains many different types 6f 
scudents engaged in a variety of activities. The purpose of this study is 
to find how students with certain characteristics vary in the activities 
thev engage in and in the quantity and quality of their interactions with 
nathematics teachers. This will be done by observing a number of middle 
school students in their mathematics classes as thev progress through grades 
six, seven and eight. 

Due to the complexity of the classroom two different types of observa- 
tion art- to be done simultaneously by two observers. An individual observer 
does on I v one type of observation at a time. One observer focuses on the 
-interaction between the teacher and a few students in the class (target 
students). This observer codes certain teacher and student behaviors contin 
uouslv. Another observer focuses on the types of activities the target 
students en^a^e in and the way target students interact with their peers. 
TM* second uhsi rver do_s not code cont inuousl v , but rotates from one target 
student to another each 30 seconds. Each observer records his/her observa- 
tions on a special Iv designed coding form. 

This manual is designed to be used in two wavs, Tt is designed to aid 
"in r ? i- training of observers* Tt i c also to he used a* a reference durmc 
*he actual classroom observations,^ 

The manual is written in tvv parts. Part T r ntains descriptions of 
f j, (J f atPrniie-- of teacher-student interaction to He t i ded in the continuous 
observation. Instructions for recording the observed behaviors on tbt c^dir 
f -r-i are also in Part I, Fart IT of this manual £ive^ J-srrtptlo-s of the 
behavior^ to h* ruled in the t line- sair.pl ed observation fi.f. a rhserva* i rr : 
n tate- 1 -eri^dl- al! v f r.r one target student tr- a^thir"' nne ?_ : v* - w-tr-k- 
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tions for using the time-sampled observation coding form. 

Outlines of the observation categories for the continuous coding and the 
time-sampled coding are provided. These and the coders checklists provide 
a quick reference for observers in the classroom. Before each observation, 
the observer should review the description of each category and the distinc- 
tions between the different categories. After each observation, the coder is 
responsible for going over the appropriate checklist to ensure that the coding 
form has been completed fully and accurately. 
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PART I 
INTRODUCTION 

This part of the manual presents the coding system used to study teacher- 
student interactions in classrooms. This system is only a slight modification 
of a coding system developed by Jere E. Brophy and Thomas L. Good to record 
the classroom dyadic interaction between teachers and students. (In fact, 
large portions of this observer's manual were taken directly from the Brophy- 
Good manual witti permission. Those sections of Part I which are taken from 
the Brophy-Cood manual are printed in italics.) Emphasis is placed on the 
word dyad ic , since this system focuses on classroom interactions in which the 
teacher is dealing with a single student. 

This system does not involve coding everything that goes on in the class- 
room. It does, however, attempt to code every interaction that goes on between 
the teacher and individual target students. In addition, several aspects of 
*:he system involve preservation of the sequential nature of teacher- student 
' —evaction s so that cycles of initiation and reaction are not lost in the 
-ju'ng process. Hhi s feature is especially important for studying the commu- 
nication of per fc mane e expectations y since it allows separation of effects 
diiK primarily to the teacher from effects due primarily to the student. The 
rjslum nlso at I cos f>r the conversion of raw codes from the individual 
students ir^o j ^rcentage scores which neutralize the effects of diff ereyices 
in the at solvte frequencies of various types of interactions they have with 
*-?eir teacher. Teachers' interactions with particular students or subgroups 
of students may then be compared directly W'ith interaction in equivalent 
situations with other individuals or groups. In this way 9 quality of contact 
. //fc-if the teacher does when engaged in certain kinds of interactions with the 
rtuien*) and quantity of contact (the sheer frequency of the different 
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kinds of interactions) may be studied separately and evaluated. ^ 

General Overview 

Four different 1 types of dyadic interaction situations will be coded in 
this study. In addition, certain comments by teachers will be coded, . 
The types of dyadic interactions are: 

1. Response Opportunities , in which the student publicly attempts to 
answer a question presented by the teacher. The type of question, its cogni- 
tive level, the student response to the question and teacher feedback to the 
student response are all recorded to maintain the sequence of their occurence. 

Procedural Contacts, in which the teacher-student interaction concerns 
permissions supplies and equipment or other procedural matters concerned with 
the (student 9 s individual needs or with classroom management. 

?. Work-Related Contacts, in which the teacher-student interaction 
concerns seat work, homework, n r other written work completed by the student* 

4* Behavioral Contacts, in which the teacher disciplines the student 
or makes individual comments concerning the student 9 s classroom behavior. 

The teacher comment category is not considered an interaction type, but 
it will be coded with the interactions. Thus this category will J>|2 described 
following the four types of dyadic interactions. 

The five broad categories of teacher and student behaviors are kept 
ii^t:>^t from one another in coding and each type has its own place for coding 
nn the fading sheet. In addition to this physical separation, coding distinc- 
tions are also made concerning the nature arid sequence of the interaction 
obeervrd. "or every interaction, coders note whethvi the initiator was the 
+eaeh.er or the student and also code information concerning the teacher 9 s 
message or response to the student durzng the interactions. The coding of 
response opportunities also includes information concerning the type of question 
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uske ! and the quality of the student's response, both of which are cod 1 
before codina the nature of the teacher's feedback. The latter coding al . 
; r. rresewaticn ><f f he sequential or lev of events so that the chain 
;f ist Ion in I reaction sequences within these interactions is maintained, 

. RESPONSE OPPORTUNITIES 

The 20 ling of response opportunities is perhaps the most difficult 
c?ling in the system, since several aspects of the interaction \ave to be 

it I mi the sequence of events within the interactions mist be maintained 
i>ii indicated in the en ling. To some extent, the sequential aspects have 
ilvriij been desimel into the coding sheet, since in going from left to 
"'j'>*» 'he coder takes up coding decisions in the order in which they tend 
* - nctura 1 1 j ; first, the observer indicates the l-iigit number of the 

s*-<le % i f and the type of response opportunity; then the observer codes the level 
iirstlon; then sre/he codes the quality of the student's answer; then, 

A 

{ 

sh^-'^e codes the Letcher's feedback to the student's answer. Each of these 
isp^'is ,f coding response opportunities is described in turn below, after 
- xv' 'fiaittioK concerning the t^vm "response opportunity." 

' -\ r > t , P r • / 7 ct »c-' f r characterize "response opp or tuni ties'' as t hey ave 
, fins, n '*:is system: (a) they are public interactions between the teacher 
l- *' i single student at a Lime, but nevertheless meant for and monitored 

Zj f \e entire class or Ij the entire jroup operating at the moment; (b) they 
' ' " z ' r ttl'SJl *' ne ' - " 'her asks a question demanding a verbal response from the 
~' • J < y '\ when she zsks the student to p ublicly respond to a question requiring 
j_ r -t-vi-'i 1 response ' such as indicating something on the board,, pointing 

>' \ - * letter r>y wcr-', ric») 3 or when a target student initiates a put- 
' ' Interaction; (n) rniy a single individual student makes the response 

m 4 c ir <n'son responses in which two or more students call out the answer 
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simultaneously are not considered "response opportunities") . Thus, a 
response opportunity involves a public interaction between an individual 
student and the teacher. 

Response opportunities thus, involve individual recognition of the student 
teacher. The previously mentioned situation in which two or more stu- 
dents ?all out an ansuer simultaneously is not considered a "response oppor- 
tunity" because no individual student receives individual recognition or feed- 
u 2? : '. "ven if only a single student calls out the answer, a response oppor- 
t\nitj is coded only if ike teacher responds to him/her in some way. Should 
the teaaher ignore his/her answer altogether, it is not considered a response 
opportunity. 

The public nature of the "response opportunity" distinguishes it from 
the vir^ous forms of teacher-afforded and student-created non-public contact 
(proce h*val 9 work-related, and behavioral) . In the teacher-afforded and 
stolen* -created work-related contacts, the teacher* talks to the student ad jut 
his o~Jn individual seat work. Teacher feedback here is "private, " meant only 
f?r student involved and not for the class as a whole. These contacts 
ocrtr 2>\en individual students bring their work to the teacher to ask him about 
z* "*r when the teacher goes around the room correcting work individually at 
each dcs- r . It frequently happens that the teacher will question a student 
*jhen dealing with kirn individually about his seat work. Such an event is 
->od* 7 mder work-related non-public contacts and is not considered a "response 
opportunity ," since the question is meant only for the particular student 
-,' nv - /, v ; aru -{ Yiot 2 public question. 

'y* r mat ion * s enterel on the coding sheets by coloring in circles in the 
zi ; r ; rl ite colurms and rows. An interaction is generally coded by coloring 
in circles in a single row. First, the identity of the target student is 
noted ly filling in his/fycr one-digit number. Each target student in a class 
wil 1 be identified by a one-digit number. All interact ; '< m ire i * i \or^ 
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cul ir target student will be noted with the same number. Each public inter- 
i % lion requires the coding of several bits of information. Teacher- initiated 
public interactions require the coding of: identity of student, type of 
pe.izk*noe opportunity , level of question asked, correctness of the student's 
mswer, and the nature of the teacher's feedback. Student-initiated public 
interactions require the coding of: the student 1 s identity, type of response 
opportunity, level of question, and teacher feedback. 

li^e types of response opportunities are to be used: student-initiated , 
discipline questions, d irect questions, open questions , and call outs . Tliese 
Dili be defined below. 

Stud ent- Initiated 

Tnis is the only type of response opportunity which designates a public 
interaction initiated by a target student. The other four types of response 
opportunity are used to code public interactions initiated by the teacher* 
A stuient-initiated response opportwiity is coded when a target student asks 
tLc teacher a question or Volunteers a comneni to the teacher. The teacher 
"i t ,*,* -'.v: md f-; the '{ucstum or comment in some way other than criticizing 

*arget student for having asked the question or made the conment. Oily 
' r >- +: :e leather -responds without criticizing the student's initiation behavior 
is 7k interaction coded. 

Disciplin e Questions * 

lircipline question is a unique type of direct question in which the 
teacher ,4ees the question as a control technique, calling on the target student 
to him/he** to pay better attention rather than merely to provide a 

r»^.?f opportunity in the usual sense. In coding a discipline question, 
* \? ;odr"s should he convinced that the teacher deliberately called on the 
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student involved because of poor attention or cooperation. Usually this will 
involve direct evidence in the teacher's subsequent behavior, as when he 
respcnds to the student's inability to answer with a statement such as "Maybe 
if vom vaii better attention, you'd know the answer." Thus, discipline 
questions should be conservatively coded; the fact that the teacher may ask a 
direct question of a student who has not been completely attentive in the 
preceding moments does not by itself constitute enough evidence to code 
the discipline question, mere must be some indication that the teacher has 
deliberate ly called on the child to compel his/her attention. 

Direct Questions 

Except for the special case of discipline questions, all instances in 
•jhich the teacher calls on a target student who is not seeking a response 
opportunity are coded as direct questions. Direct questions are the clearest 
examples of teacher-afforded response opportunities. In contrast to open 
questions and call outs, in the direct question, the student does not raise*] 
hishnni, call out an answer, or otherwise indicate that he w^nts to respond. 
Instead, the teacher calls on him to respond without any indication if inter- 
est or willingness on his part. Thus, whenever a teacher publicly asks a 
puestion 'thereby creating a response opportunity) and calls upon a target 
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studcn 4 who does not have his hand up to answer it, it is coded as a direct 
question. This Includes instances in which the teacher calls on a* target 
student before he haa a change to raise his hand (as when he names the 
student before asking the question) as well as instances in which the teacher 
?allc on a child who docs not have his hand up rather than on one who does. 
Open Questiop£\ 

Ii$ the open quhstion^ both_the J&acher^nd~1fa ~s1^ett involved in 
determining who get? the response opportunity. Here the teacher asks a 
question, waits for the students to raise their hands and then calls on one 
of the students who has his hand up. The teacher creates the response 
opportunity by asking a public question, and also indicates who is to respond 
by calling on an individual student, but he chooses one of the students who 
has indicated a desire to respond by raising his hand. Thus, the open ques- 
tion is a response opportunity which is partly teacher-afforded and partly 
-student-created. An open question is coded when a target student volunteers 
to answer a teacher question and is called on to respond by the teacher. 

Occasionally, there will be difficulty distinguishing between a direct 
question 2*d an open question. This occurs when the teacher poses a question 
mJ 'Ja\ts for students to raise their hands, but calls on a target student 
f'Xt* thn coder has not been watching. The coder must quickly check to see 
if the ' irget student had his/her hand wf not. If the teacher has called 
m i target student with his/her hand up, the response opportunity should be 
errjed as an open question; if he has called on a target student who did not 
have -his/her hand up, it should be coded as a direct question . Whenever the 
codir Lc not r,ure whether or not the target student had his/her hand raised, 
thr> response opportunity should be coded as an open question . This means that 
*he category of direct questions will be kept restricted to those instances 
-\n ohiah cedars are certain that the teacher called on a target student who did 
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not sepk out an opportunity to respond. The category of open questions will 
then include both instances in which the coder is certain that 'the teacher 
called on a target student who raised his/her hand and instances in which the 
coder is not certain whether or not the . target student raised his/her hand. - 

Ca ll Outs 

Response opportunities created by target students who call out answers 
to teachers 9 questions without waiting for permission to respond are coded 
in tkv nail out column. The teacher creates the response opportunity by 
asking a public question, but one student calls out an answer to this ques- 
tion before the teacher has a chance to indicate that a particular student 
should respond. This type of response opportunity is therefore, student- 
created, in that it was not the teacher's intent that the target student 
answer the question. Besides those already mentioned, one additional consi- 
deration must be present before coders code a response opportunity under 
call out: the teacher must recognize the target student's response and make 
soT»m response to the student in reaction to it. Called out answers by target 
students which are ignored by the teacher are not considered response oppor- 
tunities and are not coded . ■ A response opportunity coded as call cut then, 
requires the following: (a) the teacher asks a public question; (b) the 
targe 4 student call,' out an answer to the question before £he teacher has a 
chance to call on anyone to respond; (a) the teacher then turns her attention 
to the student w?lo called out the answer and says something in response to 
him/her. The teacher f s response to the student must contain feedback 
regarding his/her answer to the question; the interaction is not coded as a 
response opportunity under call out if the teacher confines her remarks to 
criticism of the child for calling out the answer. It is necessary, there- 
fore, that the teacher 'make some feedback response to the target student who 
cblls nut the answer. 
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Just as there may be confusion in^istinguishing between direct ques- 
Hons, and open questions when the coder is unsure whether or not ''the target 
student has raised his/her hand, there may also be confusion in distinguish- 
ing I etween open questions* and (fall outs if the coder is unsure whether or not \ 
the teacher made some indication to the target student that he/she should r 

answer the question. There is usually little problem when the teacher calls 

*. 

on the children by name, but some teachers will call on children by pointing 
at them or otherwise non-verbally indicating that they should make a response. 
Meiers should be particularly alert with such touchers to pick up these less 
obvious cues given to children to signal their permission to respond. When K 
the coder is not sure whether or not the teacher made such a signal, and there-' 
fore is not cure whether or not to code an open question or a call out, the 
interaction should be coded as a call out . 

The decision rules in handling ambiguous situations regarding coding of 
the type of response opportunity may be summarized as follows: (a) indeci- 
sion between discipline question and direct question is resolved by coding 
direct question; (b) indecision between open question and call out is resolved 
by coding call out. The discipline question implies that the teacher deli- $ • 
t-eratety calls on a target student because he has seen that the student is 
not payitig attention and wishes to compel his/her attention; the direct ques- 
tion implies less than this, only that the teacher deliberately provides a 
ret::onse opportunity to a specific student; the open question implies a deli- 
berate provision of response opportunity to a specific child, but this deci- 
;:ion is effected h >y the fact tha+ the student is one of those with his/her 
hand up seeking an opportunity to respond; the call out implies nothing about 

the teacher's decision to provide a response opportunity since the target 

\ 

student jails out an answer before he has a chance to provide a response 

y'lMjrtunity. 

erIc I'jj 
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By following the decision rules for handling the ambiguous situations 
outlined above* coders will* in effect* err on the side of conservatism. 
This procedure helps insure the validity and interpretability of the coding 
from systematic differences in coders 9 handling of ambiguous coding situa-i 
tion. Decision rules guided by the same rationale will be provided for 
resolution of other coding difficulties in which the coder is unable to 
choose on the evidence between two categories. In each case* the procedure 
will involve resolving the difficulties by coding the category which implies 
less about communication of teacher expectations. Thus* whatever evidence 
exists in the coding for the existence of behavior correlated of teacher 
expectations will be conservative estimates of expectation effects. 

LEVEL OF QUESTION 

1 After noting the identity of the target student involved and the type 
of response opportunity, the coder now codes the level of question asked by 
the teacher. Level of question refers to the nature of the response demand 
made upon the student. Three levels are identified: process questions, 
prod uct questions, and n on-mathematics questions. The first two levels refer 
only to questions about mathematics content. The third category (non-mathe- 
matics questions) is used to code all questions that do not refer to mathematics 
Such questions either deal with subject matter other than mathematics or do 
not have objectively verifiable, right ^or wrong answers. They often ask 
the target student for her/his opinions or reactions, or they ask about her/ 
his personal experiences, home life, or other factors in her/his personal back- 
ground. The three levels of questions are defined as follows: 

process Questions 

Tlxis is the most complex level of question* in which* the target student 
is required to explain something in a way that requires her/him to intergrate 
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facte, or to show knowledge of their interrelationships. It most frequently 
is a "why?" or "how?" question and usually requires an extended phrase or 
sentence for formulating an adequate response — single word answers are not 
usually sufficient. A process question requires the student specify the 
cognitive and/or behavioral steps that must^be gone through in order to 
calve a problem or come up with an answer. 
Froduct Questions 

I^oduct questions se^k to elicit a single correct answer which can be 
expressed in a single word or a short phrase. Product questions differ from 
pix>eess questions in that they only require knowledge of a specific fact and 
do not force the target student to integrate several facts or to make infer- 
ence;; from them. Product questions usually begin with "what?," "when?*" 
"where?," "how much?," or "how many?." Many of the response opportunities 
vill be coded as product questions, as when the target student' is asked to 
j r 'v# the answer to r homework or classwork problem. While the student may 
kvjr to go through many cognitive processes in order to arrive at the answer, 
V.e question itself as asked does not require her/him to verbalize these pro- 
-*ersec but *nly to pro Iuc$ the answer. So long as this ir true, the question 
13 •/ product question and the response demand on the target student is less 
-_i a** ; i is for a process question, since less is required of the student and 
rince the rossi 7 ilify remains thfzt she/he might guess the answtr without 
knowing the process that the teacher wants her/him to know. 

l>i : '[uesL •* -jnj the target student does not have to produce a 

.iu li ct 'in* ive response but may instead simply choose one of two or more implied 
>. r * ~*rppt ssed ilternutives. Included are yes-no questions, either-or questions 
MtJ 'in* rt\o which present more than two alternatives buc which make it clear 
that *he correct answer io one of the alternatives presented. Occasionally, ^ 
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a large number of alternatives will be present. This nevertheless, is still 
coded as a product question . 

i 

Note that certain kinds of questions which might appear to be quite 
complex may nevertheless be coded as product questions . A question such as: 
"When you divide 2/3 by 3/4 is %he answer larger than 2/3 or smaller than 
2/3?" is coded as a product question because it is essentially an either-or 
question in which the respondent can take his/her choice between one of two 
or more alternatives. The key factor , then, in choosing between process and 
product questions is not so much the content of the question itself but the 
level of response demand made upon the student . 

Non-Mathematics Questions 

The preceding distinctions between process and product questions apply 
only to questions dealing with mathematics. They require the student to 
respond to a question concerning mathematics. The two types of questions 
differ from one another in the complexity of response demand made upon 
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the students, but they have in common the fact that they apply only to 
mathematical subject matter. The category of non-mathematics questions 
includes all teacher questions which do not fit the preceding two cate- 
gories because they ask the student to make some non-mathematical contribu- 
tion to classroom discussion (questions about personal experiences, prefer- 
ences or feelings, requests for opinions or predictions, discussion of non- 
mathematical subject matter such as English grammar, etc.). Non-mathematics 
questions will often occur during breaks in a^thmic routine, although they 
may also be asked at any time during formal lessons. They often occur when 
the teacher is introducing a lesson for the day ("Have you ever gone to 
Chicago? How long did it take to travel to Chicago?"). Questions such as 
these, while relevant to the coming lesson, do not require the child to 
show skill or knowledge of mathematics; they merely ask her/him about her/his 
previous experiences. 

The distinctions made previously between process and product 
questions within the realm of mathematics content do not apply to non-mathe- 
~,atz"J questions. That is, any question which is a non-mathematics question 
ir simply coded as such, regardless of the apparent response demand built into 
the question. Most non-mathematics questions take the form of product questions 
and would be coded as such if they were math questions. The child is asked, 
an either/or question or a question which is answered yes or no. Coders 
r.hould' be particularly alert ^to avoid confusing the coding of such questions. 
If the question deals with mathematics knowledge or skills it is coded as 
z : s<A'*<Jt question. If it deals with personal experiences, opinions or other 
non-mathematical matters, it is coded as a non-mathematics question. The 
proper coding of level of question therefore, requires two separate coding 
decisions : (a) first the coder must decide whether or not it pertains to 
mathematics; (b) if it is a mathematical question^ the coder must also decide 
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whether it is a process or product question. The latter distinc- 

tions are not made among the non-mathematics questions, which are coded 

under the single label. 

Confusion between mathematics questions and 
non-mathematics question must be resolved. Often the question as asked will 
be ambiguous ("What do you think would happen if ..."), and the coder will 
have to await the teacher's feedback to the target student's response in 
order to determine how she/he is going to treat the question. If the teacher 
is searching for a particular kind of answer and treats the target student's 
responses as right or wrong, the question is treated as a mathematics question. 
It is coded as process or product. % On the other hand, if the teacher 

simply accepts any answer that the student gives and seems to be merely 
trying to get students to talk or^To make a guess, the question is treated as 
a non-math question. In general, then, if the teacher seems to be using the 
question to test or teach mathematics knowledge, the question will be coded 
as process or vmduct. If he/she treats the student's responses as ' 

opinions or guesses and does not evaluate them as correct or incorrect, the 
question is coded as non-mathematical. 

STUDENT'S ANSWER 

After coding Ihe target student's identity, the type of question and the 
level of question, the observer codes the student's answer in one of four 
categories: correct, vartiallu correct, incorrect, and no response. The 
teacher's reaction is taken into account in determining the correctness of 
the student's response. Frequently, teachers may ask ambiguous questions 
which are answered correctly or partially correctly from one point of view 
but which are treated as incorrect by the teacher, who was looking for a 
very specific answer. Thus, it is the teacher's perception of the correct- 
ness of the target student's response which is coded, not the coder's perception. 
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This distinction is important because the next variable coded is the teacher 9 s 
fcsd^ack to the student* s answer as perceived by the teacher* Consequently , 
if the teacher reacts to a response as if it is wrong , it is coded as wrong, 
even though another observer might consider it to be partially or even com- 
pletely correct* 
Correct Answers 

If the target student answers the teacher's question in a way that satis- 
fies him/her, the answer is coded as correct. Determination of whether or 
not the teacher is satisfied with the target student's answer dyes not nece- 
ssarily require that the teacher positively affirm the answer or make some 
favorable response to it. Instead, the target student's answer should be 
considered qprrect unless the teacher makes some positive action suggesting 
dissatisfaction with it (explicitly explaining that the target student's 

answer is incorrect or only \partially correct, giving the "correct" answer, 

\ 

or asking someone else to answer the same question) • If the teacher does 
not make an attempt to improve upon or replace the student's answer with 
another, the answer is considered correct* This means that some answers 
that the coder would not accept but which the teacher treats as correct are 
+o be coded as correct answers* 0 
Part-Correct Answers 

— \^ . \ 

p\rt-correct answers are answers which are correct but incomplete as 
far as rfcey jo or answers which are correct from one point of view but not 
the answer that the teacher is looking for* Again, the teacher's feedback 
response my determine the way the answer is coded v If the teacher indicates 
that the target student's response is correct but incomplete, or if she/he 
indicates that\the response is correct or defensible but not the answer that 
she/he is looking for, code the response as part~correct* 

X W w 
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Incorrect Answers 

Responses coded as incorrect answers are those in which the target 
student's response is treated as simply wrong by the teacher. The teacher 
need not explicitly tell the target student that she/he is wrong; he may 
indicate this indirectly by searching for the answer from someone else or 
by providing it himself. In one of these ways, the teacher indicates that 
'the target student 's answer is not an acceptable response to the question 
he lias asked. 
Nc . espon3e 

The preceding three types of answers (correct , part-correct and incorrect) 
all refer to instances in which the target student makes a substantive 
response to the teacher's question. All cases in which he fails to do so, 
either by making no response whatever or by 'indicating through word or ges- 
ture that he cannot answer the question, are coded as no response. "The 
student ne.ed not make some positive action to be coded in this category; if 
the teacher asks him a quebcion and waits a time for an answer but then 
moves on to somebody else when he does not respond, the first student is 
coded for no response. Occasionally, an ambiguous situation will arise when 
the target student mumbles something indistinct. If the teacher reacts in . 
thin situation as if he has understood the student to make a substantive, 
response, the response will be coded in one of the preceding three categor- 
ies. If the teacher cannot understand the target student, he is coded for 
no response . 

TEACHER'S FEEDBACK REACTION 
After identifying the student by number, coding the level and type of 
question and coding the quality of the target student's answer, the coder 
completes the sequence for coding response opportunities by indicating the 
nature of teacher's feedback reaction to the target student's answer. This 
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Notice that the section of the coding sheet for teacher feedback is 

different from the other sections of the sheet. The circles in the feedback 

t 

section contain the numerals 1, 2, and 3. These numerals indicate the order 
of occurrence of types of feedback in situations where the teacher gives 
<nore than one type of feedback to a single student response or student ques- 
tion. Four types of teacher feedback are coded in this system: positive 
feedback, neutral feedback, negative feedbacks and sustaining feedback* At 
tames, the teacher will give more than one type of feedback for a given stu- 
dent response. For example, when a target 'student answers a question incor- 
rectly and the teacher responds by saying that the answer is incorrect, at 
times the teacher continues with that student by asking the same question but 
in a rephrased form. Under these circumstances the teacher has used two dif- 
ferent types of feedback with the student. The teacher has used negative 
f eedba ck followed by sustaining feedback . This coding sheet maintains the 
ordering of the types of feedback given. So for the example given above, 
the o ne-circ le should be marked for negative feedback since the negative 
feedback was given first * The two-circle should be marked for sustaining 
feedback since that feedback was given second . The four types of teacher 
feedback to be coded are described below. 

The first three feedback categories (positive, neutral, and negative) 
are designated as "terminal" feedback, which differs from "sustaining" feed- 
back. r ne categoric s of oustgining fee-dback uialude teacher behavior Which 
-* ' r\-r th I'Scipoica opportunity by providing a seconi chance to deal with 
w r.ariL c ^*rated -rieslions . Use of sustaining^ feedlack regetions is an 
; ->L?-*r yf thf teacher's willingness to stick with the target student until 
>"u-> produce an acceptable answer. Terminal feedback, on the other 
hand, brings the response opportunity to a close. With terminal feedback 



18 

78 



reactions, the teacher either gives the target student the answer or sees 
that she/he gets it from someone else, or' merely makes a feedback or evalua- 
tion response without supplying the answer. In either case, the teaoher does 
not sustain the interaction and provide additional response opportunities. 

At times, teacher feedback to a target student may contain comments which 
are of interest other than as feedback reactions. When the teacher gives 
feedback which contains certain types of comments, the teacher's behavior 
is coded in two different places on the coding sheet. Since the teacher 
has given feedback to the target student, the appropriate feedback category 
or categories are coded. At the same time, the teacher may have commented 
about confidence, usefulness, steeteotyping , enjoyment, expectations, or attri- 
butions. These aspects of the teacher's feedback are noted either under 
Teacher Comments or are written with Observer's Notes. A description of the 
coding procedure for teacher comments is given after ttu section in this 
manual concerning non-public teacher-student contacts. 

Pos i t iy e F eedback 

Positive feedback is coded whenever the teacher affirms that the target 
student's response is correct or the teacher praises the target student in 
some way as feedback to a student response. In the event that the teacher 
expresses both praise and that the student's response is cdrrect without any 
other type of feedback in between, only one positive feedback is recorded. 
i\,sltlvt feedback may be indicated either verbally ("Yes," "That's right," 

iv," "Croat!" ft<. .) or non-verbally (shaking head up and down). At times 
t( ... ;, , , m.iv Jnhii-ifni*. respond to any student response with "Yes," or "Okay." 
. r„i . !..dl. >< .• -i iv appear to have n neutral effort .>n students, 

.-t.il i he ..»!«.•: a*, pos it ivy t eedback. 



ERIC i 



> } 

A. 



19 

79 

N eutral Feedback 

N eutral feedback is coded when the teacher gives no feedback to the 
target student or when the teacher asks another student the qeustion without 
indicating^ whether the first student's response was correct or incorrect. 
Thus, feedback which does not indicate the correctness or incorrectness of 
the target student's response and at the same time does not praise or criti- 
cize the target student's response is coded as neutral feedback . 

Negativ e Feedback 

When the teacher responds to a target student's answer by indicating 
that the student's answer is incorrect, this is coded as negative feedback . 
In addition, any instance of teacher anger, criticism, or disgust expressed 
in response to a student answer is coded as negative feedback. Negative 
feedback may be expressed either verbally or non-verbally . 

Any verbal response which disparagingly refers to the target student's 
i>->tnlle?tual ability, or more frequently, his/her motivation to do good work^ 
J? coded as negative, feedback . Statements of the latter type by the teacher 
r vij le jzctm 7 Zy true (i.e., the student may not have been paying attention) 

*■* -vij ie unverif table gratuitous rejection ("You just don't care."). Both 
are ne^rrthetess coded as negative feedback, since this coding refers to 

t. ' f c behavior per ce and not to the veracity or justification for 
S . 'Vr statements. Some types of criticism should be coded in Teacher 
nments in addition to being coded as negative feedback. 

S \ i stainiqg Feedbac k 

"hi:: category ;p sustaining feedback, in which the teacher sustains the 

v .-.>; p-jriupJ ty ant provides the target student with a second chance to 

rez-'.ni. A fir^t example of such a reaction is when the teacher simply 

re peat;: the question . This will almost always occur when the target student 

his rrude no response, although it may also occur at times in which he/she has 

i i y 

JL JL <J 
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given an incorrect response. In any case, if the teacher aske a question, 
waits some time without getting the correct answer, and then repeats the 
question to the same* target student, his feedback reaction is an example of 
sustaining feedback . The teacher need not repeat the entire question word 
for wori in order to be coded in this category. Truncated versions of the 
original question and short probes to determine if the target student can 
make any response to the original question, are both coded as sustaining 
feedback . For example, to the original question, What is the answer to #24?" 
the following responses are all coded as repeats question: "What number?," 
"Well?," "Do you know?*," "John?" (The latter said in a manner that communi- 
cates that the teacher is waiting for the target student to respond to the 
original question). 

Another example of sustaining feedback occurs when the teacher sustains 
'.he response opportunity fm rephrasing the question or giving the target 
student a clue as to how to respond to it. Usually the rephrasing of the 
question in this situation will be such as to simplify it, particularly in 
moving from one question f"What do we call this type of fraction?") to a 
simpler' question ("Is it proper or improper?"). Rather than rephrase the 
question in this manner, the teacher may provide a clue expressed as a 
declarative statement: "Its value is greater than 1." 

The material provided by the teacher in rephrasing the question or 
giving a clue may or r may not be helpful for the target student certain 
type.c of clues may actually confuse rather than help. This fact should not 
hp, 'il>nw*d to influence the coding. So long as the teacher does something 
vkiih [s intended by the teacher to help the target student answer the origi- 
nal na tion, the teacher's action is coded as sustaining feedback . 
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Sustaini ng feedback is also coded when the teacher asks a new question 
of the same target student as feedback that target student's response. The 

occurence of sustaining feedback presents a special coding problem because this 
type of feedback gives the tax*get student a new response opportunity . This 
n&o response opportunity must then be coded for level of question, quality of 
answer and additional feedback from the teacher. At the same time, the fact 
that 'i is a follow-up to an origiral response opportunity rather than a 
wholly new response opportunity must be maintained in the coding system. This 
is accomplished by skipping down to the next row whenever sustaining feedback 
is- joded, thereby bringing a close to the coding of the original response 
opportunity and beginning the coding for the follow-up response opportunity. 
X the next row, the level of question, the quality of the target student's 
unswer and the nature of the teacher's further feedback is coded but the tar- 
jet student r s number is not repeated in the student number section . Thus, 
coding of question type and identification of the number of the target student 
involved is done only for original response opportunities; follow-up response 
opr -rtii.nl ties occuring due to sustaining feedback in reaction to the original 
vuf.rnnze opportunities are coded only for level of question, quality of target 
.'Vrur^ns answer and type of teacher feedback. 
, Proper coding of such a sequence is exemplified in rows 2, 3, and 4 of the 

sample coding sheet found in Appendix Two. Beginning in row the coding exam- 
ole implies iliat the teacher asked a direct question of target student number 
6 y that the question was a product question, that the target student failed 
to give i response and thit the teacher reacted in this instance by repeating 

e question. Afte^ coding the preceding information as in row 2 in the exam- 
ple, the coder then moves down to row 3 and codes the information there which 

ERLC ±U 
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says the following: The question is a product question (since it is a repeat 
of the original question); the target student this time answers incorrectly; 
the teacher reacts th^'s time by negating the wrong answer and then by rep^ras- 
ing the question or giving a clue. Since this sequence also culminates in the 
appearance of sustaining feedback, as noted by the "2" under the sustaining 
column, the coder again skips a row and codes the third response opportunity 
of the sequence in row 4. In this instance , the coding in the example tells 
that the rephrased question was a product question; that the target student 
resvorAcd correctly this time; and that the teacher reacted by affirming the 
turgct student's response as his terminal feedback. Thus, in the example 
provided an original response opportunity as noted in the column under the 
direct questions eventuated in three different response opportunities, each of 
which was coded for level of question, quality of target student's response 
and the type of teacher feedback. The coding allows for retention of all of 
this information in the sequence in which it occurred, as in the example in 
Appendix Two. The fact that the sequence occurred as an original response 
opportunity that was followed-up by two others rather than three separate 
and unrelated responsp opportunities is also preserved in the coding. 

other than ?he special conditions requiring skipping to a new row when 
sustaining feedback occurs- the coding of tea^ier'e feedback reaction simply 
involves noting the appearance of new codable feedback categories in the order 
in which they appear. The coder merely enters a "I" in the appropriate column 
for the teacher f s first codable reaction; any additional codable reactions are 
numbered consecutively thereafter* 

Since it is rare for more than three such responses to occur as teacher 
feedback to a single response by the target student, only three columns are 
printed on the coding sheet. Thus, the observer codes the first three teacher 
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feedback responses as described above and must ignore any further feedback 
to a single student response. If a fourth or fifth feedback response is par- 
ticularly noteworthy, the observer should note its occurrence in the Remarks 
section on a separate sheet of paper* 

He-lundant repetitions within the category of terminal feedback are not 
multiply coded. For instance, the corrment "Yes, that's right, it's improper" 
woull simple he coded as one affirmation of the correct Response (not as three 
such affirmations) . 

NON-PUBLIC INTERACTIONS 

'^ne preceding material has dealt primarily with the coding of response 
opportunities. Description of the coding procedures involved has frequently 
tee-i complicated because of the many distinctions to be made and the neces- 

»J f or maintaining the sequence of events in the coding of the interactions. 
7*7*. coding of non-public interactions to be described below typically require 
onij the entry of the target student's identification number in the proper 
- T 'ice the coding sheet and coloring in the appropriate circle to describe 
the interaction. 

Von-public teacher- student contacts differ from response opportunities in 
*\it the f ea:her ir dealing privately with one target student about matters 
' f'i'S.ymratif to Hm/ker wither than publicly about material meant for the 
jr " class as <i whole. The latter distinction is the key one, since non- 
•u: ic -cavher- student contacts are not always private (the teacher may talk 
r _i \-j/< ! voice or address the child from across zhe room). Such interactions 
are r.cver+hcless coded as non-public as long as they involve matters idiosyn- 
>y^ ' ? +o tm target student and are not public questions (response opportu- 
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" Non-public interactions are divided into procedural contacts, work- 
related contacts and behavioral or disciplinary contacts. They are also 
separately coded according to whether they are initiated by the teacher 
(teacher-afforded) or by the student (student-created) . The coding also 
reflects certain aspects of the teacher's behavior in such contacts. 

Work- R elated Contacts 

Work-related contacts include- those teacher-student contacts which have 
to do with the pupil's completion of seat work or homework assignments. They 
includ° clarification of the directions, soliciting or giving help concerning 
how to do the work or soliciting or giving feedback about work already done. 
Work- related interactions are considered student -created if the target student 
bakes it upon himself to bring his work up to the teacher to talk to him about 
it r raises his hand or otherwise indicates that he wants to discuss it with 
him. Work-related interactions are coded as teacher-afforded if the teacher 
gives feedback about work 1 when the target student has not solicited it (the 
teacher either calls the target student to come up to his desk or goes around 
the room making individual corrments to the students). - Student -created contacts 
ace not planned hj the teacher and occur solely because the target student has 
sjught him out; teacher-afforded contacts are not planned by the target student 
and occur solely because the teacher initiates them. Separate space is pro- 
vided for- coding student-created and teacher-afforded work-related interactions 
on the coding sheet, and the coder indicates the nature of an individual 
dyadic contact by where he/she codes the interaction. 

■ / ^TaMition to noting the interaction as a work interaction and as an 
inunction which is student- created or teacher-afforded, the coder also 
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indicates the nature uf the teacher's feedback to the target student during 
the interaction* He indicates this by using one or more of the five columns 
provided for coding teacher 9 8 feedback in work-related interaction: praise, 
rroceso feedback^ product feedback, criticism, or "don't know". The first four 



teacher feedback. The additional "don't know" category is added for this coding 
because frequently the individual teacher-student interaction that occurs 
in the dyadic contacts will be carried on in hushed tones or across the room 
frun the coder where she/he cannot hear the content of the interaction* In 
suc}< cases, where she/he is unable to code the nature of the teacher's feed- 
back because she/he cannot hear it, the coder notes the occurence of the 
'work-related interaction and the fact that it was either teacher-afforded or » 
student-created, but enters the target student's identification number in the 
"ion't know" column. Coders should note that the "don't know" column has a 
very special and specific meaning for this coding. It should be used only when 



the coder cannot hear the teacher r s feedback. It must not be used when the 
colev in unsure about whether to code the teacher's feedback as process or 
prcluct. Thus, use of this column signifies that the coder could not hear 
the interaction, not that she/}ie has difficulty in making a coding decision 
on the basis of something that she/he was able to hear* When a coder is 
unsure as to whether to code pi>ocess or product feedback, she fixe should code 
product feedback as in any other situation. Similarly, if she/he is unsure 
whether to code praise or criticism in addition to feedback, she/he should 
'?-!( only feedback, thus preserving the coded instances of praise and criticism 
to those cases in which the coder was sure of the coding. Thus, entries in 
rhr "don't know" column will indicate solely that the coder could not hear 
*he teacher feedback in the interaction involved. 

^odirty of work-related interactions according to the principles above is 



•f ~hece categories have the same meaning as they have in other coding of 
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exemplified in rows 10, 11, 12 3 and 13 of the Teacher-Student Interaction coding 
sheet in Appendix Two. The number "4" in row 10 indicates that the target 
student whose number is 4 approached the teacher to discuss his/her work and 
was given product feedback. Similarly, the "2" in row 11 under the feedback 
column for afforded work-related interactions indicated that the teacher 
initiated an interaction with target student number 2 regarding his/her work 
and also gave product feedback. Thus, both of the preceding teacher- student 
contacts were related and involved the teacher giving product feedback to the 
student. However, the contact involving target student number 4 was initia- 
ted by the student^ while the contact involving target student number 2 was_ 
initiated by the teacher. This difference is reflected in the placement of 
the two numbers on the coding sheet. Similarly, the number "0" in row 12 
under the "don't know" column for created work-related interactions indicates 
that target student number zero sought out the teacher to discuss his/her 
work but that the coder could not hear the interaction and therefore could 
not code the nature of the teacher's feedback. 

Tlie coding in row 14 under created work interactions illustrates the 
procedure to be followed when the teacher's feedback includes more than one 
codable category. The placement of the number "5" indicates that target stu- 
dent number 5 sought out the teacher to disc.-js his/her work and that the 
teacher responded with product feedback. The mark under the "praise" colxmn 
in the same row indicates that in addition to giving him/her product feedback 
the teacher also praised him/her. 

The coding steps to be taken in the coding of work-related contacts may 
then be summarized as follows: (a) the coder enters the student's number^ 
ft) the coder determines whether the contact is initiated by the teacher or 
by the student; (a) the coder then determines that the contact is indeed a 
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aork-reUted contact and nub one of the other types of teacher- student contacts; 
fd) tie coder notes the teacher's response to the student or the feedback 
given to hvn/^er and at this point darkens the appropriate circle; (e) should 
the teacher produce additional feedback responses to the target student besides 
t*:at already indicated in the coding, ^the coder darkens additional circles 
next to the original one darkened. 

PR OOF DURAL CONTACTS 

The category of . procedural contacts includes all dyadic teacher- student 
interaction which Is not coded as work-related contacts or as behavioral . 
contacts. Thus, it includes a wide range of types of contacts, most of which 
are initiated on the basis of the immediate needs f the teacher or target 
student involved. Procedural contacts are initiated by the target student 
for such purposes as seeking permission to do something, requesting needed 
supplies or equipment, reporting some information to the teacher (tattling 
on other students, calling the teacher 9 s attention to a broken desk, etc.) > 
getting permission or information about how to take care of idiosyncratic 
needs (going to locker, getting a pass to get help during another period, etc.), 
as well as a variety of other contacts. In general, any dyadic interaction 
initiate! by the target student which does not fit the definition of work- 
related contacts is coded as a procedural contact . Procedural contacts 
initiated by the teacher usually have to do with classroom management or with 
the teacher being aware of and handling some idiosyncratic need in the target 
■3iu 7 e*t. Examples include asking individual target students to run errands, 
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carry out a particular clean-up job, pfess out equipment or supplies, and 
similar interactions in which the teacher enlists the target student's aid 
in classroom management, as well as contacts initiated by the teacher to 
handle a particular situation idiosyncratic to the target student involved 
(to see of he/she is sick, to give him/her a note to take home to his/her 
parents, etc J. In general, any dyadic interaction initiated by the teacher 
that does not fit the definition of work-related interactions or behavioral 
interactions is coded as a teacher-afforded procedural interaction. 

An with work-related interactions, procedural interactions are separately 
coded on the coding sheets according to whether they are teacher-afforded 
or student-created procedural contacts, the coder indicates the nature of the 
teacher's response in addition to the target student's identification number. 
Three categories for coding teacher's response are provided: praise, feed- 
back, and criticism . Praise and criticism have the same meaning here as 
elsewhere and are coded if they occur as part of the teacher's response. All 
teacher reactions to student-created procedural contacts which do not contazn 
praise or criticism are coded as feedback. This means that a large, variety 
of teacher reactions will be coded in the feedback category, reflecting the 
heterogeneity of types of procedural contacts. Thus, coding of a created 
procedural contact with teacher feedback means that the teacher responded 
In some way to the target student's expressed need or question without either 
praising or criticizing him/her. The numbers in rows 15, 16, and 17 of the 
ceiicl hrocednre Non-Public contact column in the example Teacher-Student Inter- 
xaii-jn sheet in Appendix Two exemplify the proper coding of these instructions. 
Ik vois L5 $ 'the number 6 and the other darkened circle indicate that target 
student number 6 approached the teacher on a procedural matter and was 
criticized by him. The mark in the feedback column next to the criticism 

.indicates that the teacher also gave some feedback to the target student's 

I f * r J 
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need in addition to criticizing him. The criticism involved may have been 
due to the fact that the target student left his/her seat to come and see 
the teacher, or it may have been connected with the particular procedural 
matter that the target student took up with the teachep. In any case, the 
ceding indicates that the target student did in fact approach the teacher on 
j procedural matter, that the teacher 9 s response was to criticize him/ 

her for something, and that the teacher also gave feedback regarding the 
procedural matter itself. The numbers in the tods IC and 17 indicate that 
target student number 0 and target student number I came to the teacher 
m procedural matters and were given feedback regarding those procedural 
matters without any teacher praise or criticism being involved* 

Occasionally, there will be difficulty determining whether a given 
teacher- student dyadic contact should be coded as work-related or procedural * 
Most confusion will be eliminated in this area if it is remembered that any 

9 

questions or clarification about the directions for the assignment involved 
arp coded as work-related, while questions having to do with equipment or 
supplies are ceded as proceduat m Thus, if the target student asks the teacher 
to repeat the page numbers that he/she is supposed to complete in his/her 
*\oorkbo6k, asks if he/she should start the assignment right now or later, or 
ha^ some other question regarding the immediate specifics of the assignment, 
the interaction is coded as a created work-related dyadic contact. On the 
other Ivxnd, if the target student comes up to, the teacher before starting his/ 
her assignment because he/she needs a pencil, has run out of paper or }ias 
some other problem with supplies, the interaction is coded as a created proce- 
dure 1- dyadic contact. 
2FHA VIORAL CONTACTS 

Behavioral contacts are coded whenever the teacher makes some comrint 
upon the target student 's classroom behavior. They are subdivided into 
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praise and criLinurm . The coder noted the information by entering the target 

student identification number and darkening the circle in the appropriate column. 
Behavioral evaluation contacts are considered to be teacher- afforded , although 
they usually occur as reactions to the target student's immediately preceding 
behavior. Nevertheless, they are teacher-afforded in the sense that the 
target student usually does not want and does not expect the interaction and 
the teacher chooses to single the target student out for comment. The condi- 
tions for coding this category are: (a) the teacher singles out the target 
student for comment upon his/her classroom behavior; (b) the interaction con- 
cerna only his/her behavior and does not involve praise or criticism in 
connection with work-related or procedural contacts as defined above. Some 
behavioral criticism may occur in work-related and procedural contacts and 
in those situations, it appears in the coding for work-related and procedural 
interactions. The category of behavior interactions is used only for those 
instances in which the teacher singles out the target student for comment 

solely on the basis of wanting to discuss his/her classroom bahavior. Work- 

* 

related or procedural matters are not involved. 

Praire 

This category will be used relatively infrequently with most teachers, 
although it will ftecur. Occasionally, target students will be singled out 
for special praise for their classroom behavior. Praise coded in this category 
cili also sometimes - occur after activities but not in relation to specific 
responses during those activities ("Pat must have studied hard last night."). 
Idiosyncratic teacher euphemisms that carry the same sorts of meanings as 
the preceding examples are also considered to be praise ("Lee is really hang- 
ing in there today."). Whenever the teacher singles out a target student 
1 for such praise, coders should enter the target student* s identification 
number in the praise column under behavioral teacher-afforded contacts. 
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Warn i ng or Critic ise 

This category refers to teacher behavior in singling out for comment 
a target student engaging in inappropriate or undesirable classroom behavior. 
Comments which function as either warnings or criticism are coded in this 
category. Usually teacher's warnings will occur in situations in which the 
target student is doing something that is not nececsarily or always prohibited 
but which, is troublesome at the moment. In such instances, the teacher will 
single out the target student to inform him/her that his/her present behavior 
is inappropriate. Examples of this are as follows: "Lee, you're getting too 
noisy" "Try to figure out the answer on your own, don't copy from your neigh- 
bor" "Pat, you can talk to Bill if you want to, but stay in your seat." 

Behavioral instructions given to the child merely in the interest of 
information or classroom management and without any connotation of warning 
or criticism would be 'coded as teacher-initiated procedural contacts, lite 
same instructions given in a slightly different dontext which connoted more of 
a warning and perhaps implied that the child should know better ("John, sit 
down, Mary can't see when you stand up like that.") would be coded as behavi- 
oral warning or criticism * If the same senteftioe were snapped at the child or 
J^lijer&l with anger or exasperation, it would also' be coded as behavioral 
warning or critic i .n . - . . 

fading of behavioral evaluation is exemplified in the final three colypms 
of the ^eacher-Student Interaction coding form in Appendix TUf&. The marks in 
the next to the last row indicate that target stude>it number 6 was singled out ' 
fo.r- praise by the teacher. The marks in the last row indicate that the teacher 
delivered behavioral warning or criticism to target student number 2. 

/ •* T 
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TEACHER C CEMENTS 

For the purposes of this study, certain types of teacher comments direc- 
ted to individual target students in public or privately, are to be recorded. 
The instructions for noting teacher comments are given in Appendix Three. 

GENERAL CODING CONVENTIONS: VALIDITY 

Certain general coding rules and conventions huje been established which 
cut across all the coding categories and which may be relied upon for guidance 
in determining what to do in ambiguous situations. Thesa contentions were 
est xbl 'shed *Hth particular attention to' the problem of ensuring the Jalidity 
of juh't in studies of teacher communication of expectations through differen- 
tia -^havi'jr tauar*l different students. The basic general conventions are 

l - m d~J-*-lr»j is coded whenever the coder is not sure which target student 
:;is *• '-.racting Jit'' the teachers. Do not guess about the identity of the 
V ' * ' idcr.i . /his convention is important to aOoi I contamination of cLs'**- 
* it i lita bg tKe expectations of the coder. Cuer,ses abuvt the identity of 
fht: .-'.a tents; in ambiguous situations are likelg to be Influenced by the 
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coder's expectations of which students would he likely to Jiave the sort of 
dyadic interaction with the teacher that has just occurred. While this prob- 
lem will occur rarely, it sometimes does happen that the coder is aware of 
a dyadic interaction lut was not able to determine which student was inter- 
acting with ihr teacher 9 In these situations , the occurrence of the dyadic 
interaction is ignored, and nothing is coded at all. 

2, The coder makes decisions concerning the correctness of a target 
student's answer by noting the teacher's reaction to the answer. If an ambi- 
guous or even a correct answer is considered to be incorrect by the teacher, 
it is coded as incorrect in coding the target student 1 s answer. Similarly, 
the teacher may ask one type of question but phrase it ambiguously so the 
target student can respond to it in a different way. Consider the following 
example: ^ 

TEACHER: John* can you tell me how much 3/4 times 8/9 is? 

JOHN: Yes". (This response is possible, although it occurs rarely.) 

TEACHER: Well, how much is it? 

JOHN: Two thirds. 

T'-e preceding example and similar situations should be coded as single 
instances of product questions, not as non-mathematics questions followed by 
produc* questions. 

Teachers may frequently ask rhetorical questions in which they do not 
expect the. target student to produce an answer. These are not considered to 
be questions and are not counted as response opportunities for the target 
student even if the target student should overtly answer' the question ("The 
distance is over 100 miles, isnH it?"). On the other hand> product questions 
similzrly phrased which the teacher is treating as questions and which she/he 
err >cts the target student to respond to are treated as questions and are 
coded under response opportunities. When the coder is uncertain, no response 
opportunity is coded. 
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Coding of evaluative reactions also depends on the teacher's behavior, 
not on the target student's reaction. Thus, a teacher who verbally criticizes 
the target student is coded for criticism,' whether or not the target student 
reacts to this criticism. On the other hand, a particularly sensitive target 
student might become upset upon being given simple negation following a 
response. The fact that the target student may react as if he/she has been 
ciniicized does not mean that the teacher is to be coded for criticism, when 
the teacher has simply stated that the student's answer is wrong. 

3. Coders should be thoroughly familiar with rules regarding the handling 
of ambiguous coding situations. For* each borderline between related categor- 
ies there Is a rule stating what to do in situations in which the coder 
cannot lecide between the two categories. These rules should be memorized and 
used universally so that certain categories can be kept rf clean ,r and restricted 
to situations in which the coder was sure of his/her rating. 

4. The teacher-afforded and student-created non-public interactions 
(work-related, procedural, or behavioral) are coded as single units if unin- 
terrupted, regardless of how long they go on. This means that if the teacher 
should Launch into an extended process review of the work with the target 
student in a work-related dyadic contact, the coder nevertheless notes only one 
unit for m afforded or created work-related contact and only one unit of 
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r ecce feeding i~ that '-r>^.iat. Anv codat le teacher hekavior during the 
• ■* *:i?t is n^ted tfl*'* l kr tar jet student's identification number and by 
lur 'ening the appreciate circle(s) , 

rj ut it is noted only one time and repeated instances of the same type 
of hekavior ai*e not multiply coded* Similarly, in giving feedback to the 
target student in an individual contact such as this, the teacher might 
ask several questions as a way of helping him/her discover how to do the 
work. Such questions are occuring as part of the teacher-afforded or student" 
jftfatel work-related contact and therefore are not coded as response oppor- 
tunities since they are not public questions. This convention may appear 
unwarranted to illogical at times, especially when a particularly long and 
noteworthy dyadic interaction is observed, hut it is consistent with the 
-jtker facets uf this measurement approach. To code more than one dyadic 
contact in such situations, or to att&npt to multiply code the separate 
units of teacher behavior that might occur during a single unit, would be 
to introduce inconsistency that would dissipate the validity of frequency 
nearures for the dyadic contact categories, For example, if difficulty in 
\ndrr standing the teacher produced longer average interactions and a greater 
number f teacher messages per interaction, the less-able target student 
would % e orbited with' a greater nwnbe? of such interactions and/or a greater 
.richness jf interaction tlian would a target student who was able to under- 
stand -W *nor# quickly incorporate the teacher's feedback. This is in a 
3&n&*i a special case of the more general principle mentioned above: The 
fcding nust refVect the- teacher's behavior rather than the target student's 
response to it* 

Occasionally, unforeseen types of response opportunities or other 
classroom events will occur in which the coder is not sure whether to code 
the- situation at all, or is not sure how to code it if she/he thinks it 
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should be coded. In these situations, the coder should code the interac- 
tion in whatever manner makes sense to her/him at the time, but she/he 
should be sure to indicate the units involved very clearly with a faint 
pencil mar 1 "' and should at the first opportunity 

explain the situation in detail in the "remarks" section on another sheet 
of paper. These special situations should then be discussed with the project 
i nvestigators as soon as possible (before the details are forgotten), so that 
determination can be made as to whether the data should be included in the 
study. In the present research, this problem has come up with regard to 
games and other non-academic classroom activities* Recess, free play, and 
other obviously non-academic activities are not being coded. However, teachers 
will sometimes institute games which may be considered mathematically relevant. 
- In such situations, the activities of the children may then be coded as 
response opportunities and/or recitation turns with the special nature of 
the activity noted through placement of "X f s" in the left margin and descrip- 
tion of the activity involved in the "remarks" column. Determination of 
whether or not to use these data is made on the basis of whether or not the 
activity seems to involve enough elements of academic work to justify con- 
sidering the response demands of the activity as response opportunities as 
defined above* If it is determined that the activity did not involve suffi- 
cient academic content to be comparable to the more clearly academic response 
opportunities, or if it is clear that the participation of the children was 
not under the control of the teacher (thereby making it not comparable with 
Hhev coded activities), the data are excluded from the general analysis. 

?. Praise and criticism are regularly coded teacher reactions, although 
there are many different ^-olimne and places for coding ^kfn, depending upon 
the context in which they occur. It is therefore important to avoid double 
coding these teacher behaviors. Frequently, in a teacher-afforded or student- 
l\C created work^related contact, for instance, t}& teacher will not only crvt%c%%e 
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the work per ae but go on to note that the work is poor primarily because 
of poor attention or other maladaptive classroom behavior. In one sense, 
thij -jriticism may he seen as behavioral rather than as work-related criti™ 
eisn, However 3 since it occurs Airing a work-related dyadic contact rather 
than in a contact initiated by the teacher solely to criticise the tc&get 
student's behavior, it is coded in the criticism column under work-related 
dyadic contacts (afforded or created, as appropriate}* The coder does not 
make an additional coding in the criticism column for behavioral evaluations* 
Tlie coder may^ however, code a teacher comment along with the single praise 
or criticism coding* 

8* In coding response opportunities, coders should be sure not to 
repeat the target student 9 s identification mmi>er when sustaining feedback 
is involved. This caution is necessary because in the present system, the 
ok], ' me thod o^ obtaining an accurate count of original response opportun%t%es 
2q - 8 count the number of times the target sti4dent f s number appears in the 
i^er-anse opportunity coding sections. This total will ordinarily be smaller 
tL-K the total for answers given by the target student, since whenever sus- 
* siting feedback occurs, a new answer will be coded and the original response 

^uort'unith wilt have l&i to more than one answer from the child. Coders 
Cf O ild also hear if, nini that each response opportunity must be coded at the 
fev one or more types of terminal feedback* Be especially alert to 

i- r- J*: -u m . \ in terminal feedback situations where this is appropriate* 

rhi *i its ea^if to forget. 

y 
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PART II 
INTRODUCTION 

This part of the manual describes tb£ coding system used to study the 
proportion of time students are engaged in mathematics learning activities 
and some of the characteristics of these activities, This system has been 
adapted from one developed by the Far West Laboratory for use in the Beginning 
Teacher Evaluation Study. Portions of the manual written by Romberg, Small, 

V - 

Carnahan and Cookson at the Wisconsin Research and Development Center for 

Individualized Schooling have been used directly in this manual, These 

r- 

portions are written in italics. 

The most important features to be observed are the characteristics of 
the activities target students engage in and the degree to which these 
students discuss mathematics with their peers. The physical location of the 
teachers and target students is also recorded, 

OBSERVATION PROCEDURES 

A "target* population* of six to ten students from the alass will he observed. 
The names of* the target students* selected in advance* will be given to eoefe 
observer prior to the first observation. The target students will remain 
the same for the duration of the study. The general procedure for using the 
observation system is one of "time-sampling. n This means that each target 
student will not be observed continuously* hut rather in a particular sequence 
at different moments during the observation period. The sequence or order of 
observation is determined by the observer before the observations begin and 
is maintained for the complete class period. Seating arrangement and grouping 
are some considerations to make in determining the sequence. The sequence can 
be changed for each new observation period. The observation of each target 
student composes a cycle m It is estimated that thirty 
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seconds is needed: I) to observe the activity that each student is involved 
with s 2) to code the appropriate categories on the coding form (See Appendix 
Too). The beliavior to be coded consists of only those things that the target 
student is doing precisely at the 10 second mark of the thirty second inter- 
vat. This procedure is designed to minimize the possibility of observer 
bias in sampling the moments. Codes are used to record a description of the 
event happening at the one moment in tinte to a target student* The collection 
of codes from several moments will provide a series of "snap shot$ n of what 
the observed student does during th± observation period* 

The beginning and ending of the observation period coincide with the 
beginning and ending of the time period allocated to mathematics, although 
it would be wise to spend a minute or two at the first of the period to get 
a "feel" for the class. It is very likely that the students will be involved 
in some transitional activity or other content area at the very beginning 
or ending of the period. These activities are not to be coded 

If the period is not 
fixvi and depends upon when work in another content area stops or begins, the 
observation period begins when the teacher redirects the students to mathe- 
matics and ends when the teacher redirects the students to some other area. 

T rmediatelu following the observation period or as soon as is practical, 
classroom data are recorded and the observation checked. This information and 
r' f .e co iinj are reviewed for any inconsistencies . 

i 

GENERAL PROCEDURES FOR TIME-SAMPLED OBSERVATION J 
Target Student Recognition 

The names of the_ target students will be given to the observer prior to 
tn# first observation* The first task for the observer is to learn to identify^ 
each of the target students by name and face* Students will get up and move 
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abound the room* so the observer must be able to identify each target student 
by means other than seating location. 

It is extremely important that the target students and their teacher 
do not know which students in the class are being observed. The observer 
must take care not to observe target students in such a way as to make clear 
to anyone in the class the target students 1 identity. Seating charts should 
be kept well hidden from view during observation and should not be left loose 
in the classroom. When target students move around the room during mathema- 
tics class,* the observer should be very careful not to be too obvious in 
following than. If a target student leaves the classroom for any reason, 
he/she should be coded as absent. 

Avoiding Commatication with Students } 

Another procedure that should be followed during observation is the 
avoidance of commmiaation with any students . In fact, it is usually advi- 
sdbU to concentrate on the observation and coding so intently that eye con- 
tact with students is avoided. Students will tend to ask observers for help 
Dith their work, or will ask about what the observer is doing. Observers 
will find that they do not have time to help students and code observations 
simultaneously and that a student who has been given help once will expect 
to receive it whenever it is requested thereafter. It is less distracting 
to provide terse explanations of what the observer is doing, but even this 
presents problems when the student is not satisfied with a terse statement. 
T he most reliable procedure is to concentrate on coding observations and 
avoid even eye contact with students . The routine response to any student 
qumstion should be either no response or the statement that both you (the 
observer) and the student hive work to do and should not be talking. 
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Outside of the classroom* it is possible to maintain a mope cordial 
relationship with the students. However^ it is extrmely valuable to set 
zhe standard of no ccmnunication inside the classroom* Students will recog- 
nise 2nd accept this distinction* 

Sampling Moments 

Target students must be observed in the same order throughout the obser- 
vation period . This ordering is to be done by the observer and can take 
intj consideration seating arrangement* However s once an order = has been 
determined, it should not be changed, "2%f sampling of moments should occur 
in regular cycles* The first sample of a moment should be near the beginning 
of the period allocated to mathematics* The "picture" at the ten second 
mark of the observation of a target st&dent must be the moment coded* The 
observer "takes a mental photograph" of that moment 3 then decides how it 
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should be coded and marks the appropriate categories on the form. This 
kind o f procedure is necessary to minimize observer bias in the sampling 
of moments. Distinct events often take place in a rapid sequence. The 
observer must be very rigid in coding the precise moment first observed to 
prevent confusion in determining which of several events should be coded. 
It is estimated that observing the moment, making a mental note and coding 
will take thirty seconds. Variation from this time is acceptable. What is. 
important is that the moment sampled is precisely coded. - 
Investigating the Moment Sampled 

Once the observer has sampled a moment, storing a mental photograph of 
that moment, then it is possible to conduct brief observations thereafter^ 
to determine what coding categories best describe that moment. That is, 
the observer can thereafter walk over to examine the page that the student 
was working on. The observer still codes what the student was doing at the 
moment first observed but uses the new information to record the appropriate 
content category. In all cases, it should be clear that the moment to be 
coded is the one that was sampt^d at the ten second mark. The subsequent 
observations are carried qut simply to determine what that moment really was. 
Attending to Non-Target Students- 

It is nearly impossible to prevent target students from realizing they 
are the focus of the observations. The avoidance of eye contact will help 
to reduce that extent to which target students feel self-conscious. In 
addition, it is helpful to keep the observation sheet out of the vim of any 
students. This will prevent students from reading the name of the target 
student (s) written on the form. However, the best procedure for reducing 
target student awareness of the observation is to attend to non-target students 
This can be none by asking non-target students questions and observing what 
materials they are using. At times, non-target students will be engaged in 
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similar activities as the target students. Thus, it is possible to code 
the target student behaviors by observing non-target students* 

Checklist 

At the end of the observation period* the observer should refer to the 
checklist for coding and error control (See Appendix One). In addition to 
completing all information* the observer should review this checklist and 
his fixer coding form* looking for coding errors. 

TIME-SAMPLED OBSERVATION CATEGORIES 

The following is a list of the time-sampled observation categories to be 
used with descriptions of each* For each category* a brief description is 
given first, following this brief description is a more detailed explanation. 
Attendance 

A = Absent 

Target student is absent during the observation period* 

i 

Thi s is used to indicate that the target student is not at school* or 
is otherwise unavailable to be observed. 

A brief trip to the washroom or water fountain is not 
*?fided as absence. Do not replace an absent 

tnnget student with another student during the observation period* Continue 
to ooie the target student as being absent for each cycle. 
Student Engagement 

E - Engaged 

The student is engaged in a purposeful learning activity related to 
mathematics content. 
0 =r Off-task 

Off-task describes the student when she/he is not engaged in a task. e . 
TV most important information obtained by the coding of pupil activity 
Li the engagement or lack of engagement of the student when working on 



44 . 
104 

math&mtics* That is, the crucial information to be obtained is the deter- 
mination of whether or not the student is actually working on a mathematics 
task* If the student is engaged, then engaged (E) is coded. If the student 
is not engaged, then o ff-task (0) is coded, 

The determination of engagement or non-engagement is central to^ the 
coding of pupil behavior, because this distinction is the most important 
of those involved in the time-sampled observation categories. Whenever there 
is ambiguity regarding student engagement, the observer should give the 
student the benefit of the doubt and code engaged. Off-task should be coded 
only when it is reasonably clear ^bhat the target student is not engaged in 
a purposeful mathematics task. 

Several rules are necessary for the coding of engagement. If the target 
student is engaged in a mathematics activity, this is coded as engaged even 
tho?4gk the teacher has assigned some other activity. If the student dis- 
plays both a non-engaged and an engaged behavior for the same activity, then 
the engaged behavior is coded* For example, the student might listen to the 
teacher's explanation or directions while sharpening a pencil. In such eases, 
the engagement is coded* The student can be engaged in two activities at 
once such as copying one part of an assignment while listening to the explana- 
tion or direction of the teacher. If one of the activities is a process 
activity and the other is a product aativity, the level of engagement should 
be coded as process (S). 

If the target student is not engaged in a mathematics activity, then 
this non- engagement is coded even when the student is engaged in an alter- 
native activity other than a mathematics activity. The teacher could tacitly 
accept the off-task activity of the student. For emmple, a teacher might 
interrupt a student's mathematics seatwork to ask about the outcome of a 
baseball game played the day before. In this case, the target student is 
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coded as off-task. The teacher 9 s obvious acceptance of this socializing t 
does not change its off-task characteristics in relationship to mathematics. 
Note that the coding is exactly the same if another student interrupts the 
target student to ask about the baseball game. 

The off- task code is used in some cases where the teacher overtly states 
* that the student may leave a mathematics activity temporarily for some other 

purpose. For example* a student may leave the room to get a drink or to use 
the restroom during an ongoing mathematics activity. This is coded as off- 
task even when the teacher tells the student (overtly) that he/she may leave 
zo aet a drink or use the restroom. 
Level of Engagement 

(Level of Engagement is coded only when the student is coded as Engaged.) 

S = Process 

Engagement at the process level requires that the student be working on 
* something that requires him/her to integrate facts or to show knowledge 
of their interrelationships. This level is generally in response to a 
"how?" or a "why?" question, 
T = Product 

Engagement at the product level requires that the student know a specific 
fact but does not require that the student integrate several facts or 

■ 

make inferences from them. 

The process level is the most complex level of engagement. In it, the 
itudent Is required to integrate facts or to show knowledge of their interre- 
lationships. It most frequently is an activity that asks "why?" or "how?." 
A process activity requires the student to specify the cognitive and/or 
behavioral steps that must be gone through in order to solve a problem or come 
up with an answer. 

Ihe answer in a product activity can usually be expressed in a single 

ERLC 
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word or a short phrase. Product activities differ from process activities 
in that they only require knowledge of a specific fact and do not force the 
student to integrate several facts or to make inferences from them. 
Spatial Engagement 

(Spatial Engagement is coded only when the student is coded as Engaged.) 

SV « Spatial 

The target student is coded as engaged in a spatial activity when it is 
apparent that she/he is using spatial visualization or is drawing a pic- 
ture to aid in solving a problem or in understanding a mathematical con- 
cept . 

NS = Non-Spatial 

The target student is coded as engaged in a non-spatial activity (NS) 
when he/she does not appear to be using spatial visualization or a pic- 
ture to aid in learning mathematics. 
Peer Interaction 

(Peer Interaction is coded only when the student is coded as Engaged). 
P = Peer Interaction * 

A target student ( is coded as interacting with a peer (P) when he/she 
is working on some mathematical concept or problem with one or more ✓ 
peers. 

NP ^ No Peer Interaction 

The target student is not interacting with peers (NP) 
Teacher and Student Location 

The first time the observer works in a classroom, she/he will make a 
sketch of the classroom. The classroom layout sketch should include the 
teacher's desk(s) and the arrangement of the student desks and work tables* 
Copies of this sketch will be provided for the observer to use in subsequent 
observations. 
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At the end of each observation session, the coder records the location 
where the teacher spent the majority of the class period. In addition, the 
coder records the location where each target student spent the majority of 
the period. 
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APPENDIX ONE 

Continuous Observation — Quick Reference Outline 
Response Opportunities 



response opportunity 



student- initiated 



discipline question 



direct question 
open question 

f'ai 1 out 



Response opportunities are public inter- 
actions between the teacher and only one 
student at time. They may occur in a 
large group or siftall group (2 or more & 
students) setting. They occur when the 
teacher asks a question to which a target 
student is to publicly respond. The 
question is responded to by only one 
student, in this study, a target student* 

Response opportunity initiated by a 
target student. 

This is a question asked by the teacher 
in a public setting. Teacher gives some 
indication that the question is asked to 
compel the target to pay attention. 

Teacher calls on a target student who 
has not volunteered. 

Teacher asks a question and calls on a 
target student who has volunteered to 
respond to the question. 

A target student calls out the answer to 
a question before the teacher has a 
chance to call on anyone. The teacher 
responds to the student who has called 
out the response 



Level of Question 



process quest ion 



pre duct question 



This is a mathematics question which 
requires the target student to give the 
steps that must be gone through to solve 
a problem. It is generally a "why?" or 
"how?" question. j 

A product question is one which requires 
the target student to answer with a 
single word or phrase without indicating 
how the answer was found* 
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non -mathematics question Such a question does not require the 

target student to show skill or knowledge 
of mathematics. The teacher does not 
evaluate the student response as correct 
or incorrect. 



Student 

correct answer 
part-correct answer 

incorrect answer 

no response 



s Answer 

i 

Student's answer is considered correct 
unless the teacher makes some action 
suggesting dissatisfaction with it. 

Teacher indicates that target student's 
answer is correct but incomplete, or 
that the response is correct but not the 
answer the ceacher is seeking. 

Teacher indicates that the target stu- 
dent's answer is wrong by saying so, 
providing the correct answer, or asking 
someone else. 

Student indicates that he/she cannot 
answer the question or student remains 
silent. 



Teacher's Feedback Reaction 



p^it ive feedback 



As feedback, the teacher compliments 
the target student or makes a gesture 
indicating warmth or excitement. Also 
includes teacher feedback which indi- 
cates that the student's response was 
correct. (Examples: Good, Fine, 
Wonderful, That's right, Yes) 



neutral feedback 



Teacher makes no response whatsoever to 
target student's response, or teacher 
continues without indicating whether 
student's response was correct or in- 
correct. 



nezac ive feedback 



3UGt aining feedback 
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The teacher provides impersonal feedback 
that the target student's response is 
not correct, or the teacher expresses 
personal criticism or anger. 

The teacher attempts to stay with a 
target student so that he/she can answer 
the question asked. It may consist of 
repeating the original question, rephras- 
ing the original question, giving some 
type of clue, or asking a new question. 

i id 



so 



CODING 

sustaining feedback 



Teacher 

confidence - positive 

confidence - negative 
confidence - neutral 

usefulness - positive 
usefulness - negative 

stereotyping - positive 
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INSTRUCTIONS 

Whenever sustaining feedback is coded, 
the coder skips to the next line to code 
the level of the question, the target 
student's response, and the nature of 
further feedback given by the teacher. 
If further sustaining feedback is given 
to this second response opportunity, 
the coder once again skips to the next 
line and codes the level of the question, 
student response and teacher feedback. 



Comments 

Teacher comments that the target student 
is confident in her/his ability to do 
mathematics. 

Teacher comments that the target student 

is low in her/his confidence in mathematics. 

Teacher comments about target student's 
confidence without making a positive or 
negative comment. 

Teacher says that mathematics will be 
useful for the target student. 

^Teacher says that mathematics or the 
particular topic under consideration will 
not be useful for the target student. 



Teacher comment to a target student 
saying that mathematics is equally appro- 
priate for males and females, that 
mathematics ought to be free of sex 
stereotyping or that females are better 
at mathematics than are males. 
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stereotyping - negative 



enjoyment - positive 



enjoyment - negative 



enjoviwnt - neutral 



expectations - positive 



expectations - negative 



at t ri hut ion 



Teacher* comments to a target student 
that mathematics is not appropriate as a 
subject of study for females, or that 
males are more suited to the study of 
mathematics than are females. 

Teacher states that the target student * 
enjoys or likes mathematics. 

Teacher states that the target student 
dislikes mathmatics or does not enjoy 
some aspect of mathematics. 

Teacher comments that a target student 
neither likes nor dislikes math.. 

Teacher tells a target student that he/ 
she will probably do well in mathematics 
or school. 

Teacher tells a target student that she/ 
he will probably not be very successful 
in mathematics or school. 

Teacher attributes a target student's 
success or failure in mathematics to 
ability, effort, the difficulty of the 
task, or the learning environment. 



Non-Public Teacher-Student Contacts 



student-created 



teacher-afforded 



wr rk-rt« I a ted contact 



procedural contact . 




This is a private contact between student 
and teacher that is initiated by the 
target student . 

This is a private contact between the 
target student and the teacher which is 
initiated by the teacher . 

This is a teacher student-teacher contact 
concerning the target student's seat 
work, homework, clarification of direc- 
tions, or feedback about already com- 
pleted work. 

The target student requests permission 
to do something or requests information 
about how to take care of his/her own 
special needs. Or the teacher approaches 
a target student to ask him/her to run 
an errand, pass out equipment or otherwise 
help with class management. The contact 
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whether teacher-afforded or student- 
created is to take care of a situation 
idiosyncratic to the target student 
involved • 

behavioral contact This is a teacher-initiated contact in 

which the teacher comments upon the target 
student's classroom behavior. The teacher 
singles out the target student for com- 
ment on his/her classroom behavior. The 
interaction is concerned with the target' 
student's behavior and does not involve 
praise or criticism in connection 
with work-related or procedural contacts. 



Time-Sampled Observat 

absent - A 

- engaged = E 

off-task = 0 
process - S 

product ■ T 
spatial * SV 
non-spatial - NS 

peer interaction = P 

no peer interaction ■ NP # 

ERIC 



— Quick Reference Outline 

Target student is absent during the 
observation period. 

The target student is engaged in a 
learning activity related to mathematics 
content. 

Off-task describes the target student 
when she/he is not engaged in a mathe- 
matics learning activity. 

A process level of engagement requires 
the target student to integrate facts 
or show knowledge of interrelationships 
among facts. p 

A product level of engagement only * 
requires that the target student know a 
specific fact. 

Spatial engagement is coded when the 
target student uses a figure or drawing 
to aid in solving a mathematics problem. 

Non-spatial engagement occurs when the 
target student is engaged in a mathematics 
learning activity but is not using a 
figure or drawing to aid in understanding 
the mathematics or solving the problem, 

A target student is coded as interacting 
with a peer when she/he is working on some 
mathematical concept or problem with one 
or more peers. 

The target student is engaged but not 
interacting with a peer or peers. 
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Appendix Two 
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Certain types of teacher comments which are directed to individual 
target students in public or in private are to be recorded. Some types of 
teacher comments are recorded on the Teacher-Student Interaction coding 
sheet, while other types of teacher comments are recorded on a separate 
sheet of paper with other observer remarks. Teacher comments may occur 
during other teacher-student interactions. The observer records teacher 
comments concerning: students 1 confidence in learning mathematics, the 
usefuln ess of mathematics, sex stereotyping of mathematics, student en joyment 
or liking of mathematics, teacher expectations for student performance in 
mathematics or schoo l, a nd teacher attributions of the causes of student 




success and failure. Only teacher attributions are coded on the Teacher- 

> 

Student Interaction coding sheet. The other types of teacher comments are 
recorded on a separate sheet of paper. 

Teacher Attributions 

At times, teachers .attribute the cause(s) of a target student's success 
or failure in mathematics to some perceived characteristic of the target 
student or her/his surroundings. For this observation, these causes are 
Uassified as: the target student's ability or lack of ability, effort or 
lack nf effort on the part of the target student, the ease or difficulty of 
the: task, or the enviornment of the classroom including the quality of teacher 
explanations. Attributions of causes of success for target students are 
separated from attributions of causes of failure. Eight categories of teacher 
Attributions are coded on the Teacher-Student Interaction observation sheet. 
One column is provided on the coding sheet for each of the eight categories 
of teacher attributions* These columns are located between the PUBLIC and NON- 
PUBLIC sections. 
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A~ success- ah i 1 ity_ l^A) attribution is coded when the teacher refers to 

ability as the reason for a target student* s success. A success-effort (S-EF) 
attribution is coded when the teacher makes a reference to the amount of time, 
effort, or concentration a target student seems to have expended as the 
cause of that student's success* A success-task (S-T) attribution is coded 
when the teacher refers to the ease of the material of or the target student's 
familiarity with the material as the reason for the student's success. When 
the teacher makes reference to the positive classroom environment or the 
good job that was done in explaining as the cause of the target student's 
success, a sue ces s-env ir onmen t (S-EN) attribution is coded. 

~l?hen~the "teacher attributes a targe t student* m f ai lure _ to_grasp_an idea 
to a lack of ability or talent, a failure- ability (F-A) attribution is coded. 
A failure-effort (F-EF) attribution is coded when the teacher refers to a 
failure to spend sufficient time on a task, failure to concentrate on a task, 
or a lack of determination as the cause of a target student's failure to 
understand or learn a concept or idea. When the teacher attributes a target 
student's failure to learn something to the difficulty of the task, a failure- 
task (F-T) attribution is coded. At times, the teacher will attribute a 
target student's failure to the fact that the material was not explained well 
or that the learning environment was not a good one. Such attributions are 
coded as f ai lure-environment (F-EN) . 

When a teacher attribution comment occurs as part of an interaction 
between a target student and the teacher, the attribution is coded in the 
same row as the student number and other description of the interaction. 
If the comment occurs outside of a normally coded interaction, the student's 
identification number should be darkened and the appropriate attribution 
circle darkened also. 
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When the types of teacher comments concerning confidence, usefulness, 
stereotyping, enjoyment, and expectations occur, the comment should be, 
recorded on another piece of paper with other observer remarks. Be sure to 
record the comment and the student f s identification number. These non- 
attribution comments are described below. 

Confidence 

Comments corceming a target student f s confidence in mathematics are 
classified as positive , negative, or neither positive nor negative {-h, *, N). 
A positive comment about a target student's mathematical confidence gives 
some indication that the teacher perceives the student as confident in his/he 
"ability to T^earn ma theroartcsv- When -the teacher states that she/he feels a 
target student is low in confidence concerning her/his ability to learn 
mathematics (or anxious about mathematics) a negative comment is coded. A 
comment about student confidence that falls in neither of these categories 
is coded as N (neither) . 

Usefulness 

Usefulness comments by the teacher which are directed to an individual 
target student are coded positive or negative (4-, -), A comment classified 
an pos 1 1 ive is one which indicates that mathematics in general or some speci- 
fic mathematical topic will be useful to the target student. A comment con- 
cerning the usefulness of mathematics is considered negative if it indicates 
chat mat hematics or the specific topic under consideration will not be useful 
for the target student, 

Stereo typing 

At times, teachers comment about the appropriateness of studying mathema- 
tics for males or females. A positive stereotyping comment is one which is 
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directed to a target student and which indicates that mathematics is 
equally appropriate for females and males or which says that mathematics 
ought to be free of sex stereotyping. A consnent to a target student which 
says that females are better at math than males is also considered a positive 
stereotyping consnent in favor of females. A negative stereotyping comment 
gives the idea that math is not an appropriate subject for a female student 
to excel in or that males are more suited to the study of mathematics than 
females. A teacher comment indicating that girls and boys are equally capable 
in mathematics should be recorded also, as a non-stereotyping comment. 

En j oyment 

A positiv e comment by the teacher is one which gives the indication that 
the target student likes mathematics or enjoys doing some aspect of mathema- 
tics. A comnent stating that a target student dislikes mathematics or does 
not enjoy doing some specific mathematical work is coded as negative . When 
the teacher comments that a target student neither likes nor dislikes mathe- 
matics, an S (neither) is coded. 

Expec tations 

When a teacher tells a target student that she/he will probably do well 
in mathematics or be successful in school, a positive expectation comment 
is coded. A negative expectation comment is coded when a target student is 
tM4<J that he/she probably will not be very successful in mathematics or in 
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Observer Agreement - Year I 
Teacher -Student Interaction Observation Categories 



Category 


Observer 


Agreements 
Agreements + Disagreements 


Percent 
Agreement 


iQentiiicatiuu ui 
Interaction 


2 


48 

50 c 

60 
65 


96% 
92% 




3 


52 
55 


95% 
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22 
25 


88% 




All 
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93% 




Public 
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— \ 

Initiator * 


1 
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7 / /* 
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31 » 
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89% 




All 
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118 


86% 
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Category 



Observer 



Agreements 



Percent 



Agreements + Disagreements Agreement 



TeveT~bf Question j 

2 
3 

4 

All 

Student Answer 1 

2 
3 
4 

All 

Positive Feedback 1 
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3 
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All 
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24 
31 

_9 
9 

103 
118 

44 
48 
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34 

28 

31 

9 
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109 
122 

38 
48 
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34 

26 
31 

8 
9 
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122 



84% 
97% 
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87% 
92% 
82% 
90% 
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79% 
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84% 
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Category 



Observer AgreeBttlta + BiMgremssnts 



Negative Feedback 



Sustaining 
Feedback 
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All 
1 
2 
3 
4 
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3 
4 

All 



38 
47 

27 
34 

25 
31 

8 
9 

98 

121 

44 
46 

33 
34 

30 
31 

9 
9 

116 
120 



45 

47 

32 
34 

30 
31 

7 
9 

114 
121 



79% 

81% 

89% 
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_ • Agreements Percent 

Category Observer ^ — , „, — — 

Agreements * Disagreements Agreement 



"Student-Initiated 
Work 

Lower Level 1 2 67% 

3 



2 5 56% 

/ . 9 
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• f 3 2 67% 
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» 4 4 100% 
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All 13 68% 

19 

Higher Level 1 1 100% 

1 

2 2 100% 

2 
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4 1 ' 1001 

1 

All 4* 

4 
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3 none 



4 1 100% 

1 

All 1* 

= 1 » 
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, Agreements Percent 

Category Observer ^^g^^g + Disagreements Agreement 



Praise 1 none 
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1* 




r 



50% 
88% 
100% 
77% 

50% 



Category CbmmTvmT Agreements 

Teacher-Initiated 



Praise 


X , 


none 




2 


none 




3 


none 




4 


I 
I 




All 


1* 
1 


Criticlsa 


1 


none 




2 


none 




3 


none 




4 


, = 2 
2 



Ml 2* 

2 

Dos't Itow 1 Mst 

2 none 

3 
4 



none 



All 

Prais# 1 sons 

2 nsas 

3 sons 

4 *- aoa# 
All aoii€* 



132 



0 
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Table 4 (Continued) 



Agreements Percent 

Category server ^g reea g ntg 4. Disagreements Agreement 



Neutral 1 none 



2 0 0% 

4 



3 2 100% 

2 

4 ' - 4 100% 

- 4 

All 6 60% 

10 

Criticism 1 none 

2 0.0% 



3 
4 



1 

none 
none 



All 0* 

1 

Teacher-Initiated 
Procedural 

Neutral 1 none 

2 none 



3 2 67% 

3 

4 none 

All 2* 

3 



Public or Private Interactions 



lehavioral 

Praise 1 none 



2 none 



I 

S 4 



3 song 
All none* 



1 
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Table 4 (Continued) 



ak — Agreements Percent 

Category . Observer AgMertents + Disagreements Agreement 

Criticism 1 none 

2 2 50% 

4 



4 



none 



make percent s unstable. 



9 

ERIC 



5 1001 
5 



All 7 78% 

9 



* 

Fewer than 5 occurrences during agreement checks 
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Observer Agreement - Year I 
Engaged Time Observr'lon Categories 



Category 



Observer 



Agreements 



-K-B4 



Bngageaeat 



Cognitive Level 



6 

7 
8 
9 
10 

All 
5 
6 
7 
S 
9 
10 

All 



Mr 
60 

238 
270 

Jl 
59 

174 
197 

20 
36 

133 
172 

676 
794* 

21 
25 

170 
175 

20 
26 

106 
118 

13 
14 

82* 
108 

412 



Percent 
its Agreeme n t 



466 



972 



881 
90% 
881 

56% % 

77% 

85% 

841 

97% 

77% 

90% 

931 

76% 

88% 



•The ienOBlnator is the itabtf of cycles observed for which the 
category wmt appropriate. 



ERLC 



170 



Observer Agreement - Year II 
Engaged Time Observation Categories 



Category Observer Agreements Percent 

Agreements + Disagreements Agreement 

Engagement 4 127 98% 

130 



6 91 93% 

98 

11 36 88% 

41 

14 _98 93% 

105 

All 352 94% 

374 

Cognitive Level 4 66 94% 

70 

6 56 98% 

57 

11 31 100% 

31 

14 63 90% 

70 

All 216 95% 

228 

Spatial 4 69 99% 

70 

6 50 88% 

57 

11 26 84% 

31 

14 70 100% 

70 

All 215 ~ 9kl 

228 



Category 



Observer - Agreements Percent 

Agreements 4- Disagreements Agreement 



Peer Interaction 4 64_ 91% 

70 

6 56 98% 

57 

11 31 100% 

31 

14 68 97%, 

70 

All 219 96% 

228 
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Observer Agreement - Year II 
Teacher-Student Interaction Observation Categories 



Category 



Observer 



Agreements 



Agreements + Disagreements 



Percent 
Agreement 





* Trfpnt i f ~i rat Ion of 

Interaction 


2 


20 
23 


87% 






5 


4 
4 


100% 






7 


70 
73 


96% 




• 


8 


28 
29 


97% 






11 


38 
45 


84% 






All 


160 
174 


92% 








Public Interactions 






Initiate 

i. 


2 


3 
4 


75% 






5 


* 


* 






7 


33 
34 


97% 






8 


11 

11 


100% 


* 




11 


14 
14 


100% 






All 


61 

63 ' . 


97% 



9 

ERIC 



\ 



4 
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Category Observer Agreements Percent. 

Agreements + Disagreements Agreement 



Response 

Opportunity 



Level of Question 



Student Answer 



5 
7 

8 

11 

All 

2 

5 
7 

8 

11 

All 

2 

5 
7 

8 

11 

All 



3 
4 



27 
34 

10 
11 

13 
14 

53 
63 

2 
4 



26 
34 

_6 
11 

14 
14 

48 
63 

3 
4 



32 
34 

11 

11 

14 
14 

60 

63 



75% 

* 

79% 

91% 
' 93% 
S4% 
50% 

* 

76% 

55% 
100% 
76% 
75% 

* 

94% 

100% 
100% 
95% 



9 

ERIC 



i *" 

JL 9 J. 



Category 



"*' Observer 



Agreements Percent 

Agreements + Disagreements Agreement 



Positive Feedback 



Neutral feedback 



5 
7 

8 

11 

All 



5 
7 

8 

11 

All 

Negative Feedback 2 

5 

7 

8 
11 
-All 



34 
34 

10 
11 

12 
14 

59 
63 

4 
4 

* 

20 
34 

10 

11 

13 
14 

47 
63 

3 
4 



32 
34 

11 
11 

12 
1 4 

58 
63 



* 

100% 
91% 
86% 
94% 

100% 

* 
59% 

91% 

93% 

75% 

75% 

* 
94% 

100% 

85% 

92% 



-i • u« 



Category 



Observer 



Agreements 



Agreements + Disagreements 



Sustaining 
Feedback 



5 
7 

8 

11 

All 



33 
34 

11 
11 

11 
14 

59 
63 



Private Interactions 



Percent 
Agreement 



* 
97% 

100% 

79% 

94% 



Student-Initiated 
Work 

Higher Level 



5 
7 
8 

n 

All 



Lower Leve 1 



3 
3 



3 
4 

6 
7 

2 
4 

3 
3 

15 
19 

8 
8 



100% 



75% 
86% 
50% 

100% 
79% 

1002 



\ 
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Category 



Observer 



Agreements 



Criticism 



Student- Initiated 
Wortc) 
Praise 



Neutral 



Don 1 1 know 



9 

ERLC 



2 
5 
7 

8 
11 
All 



2 
5 
7 
8 

II 
2 

5 

7 

8 

L 1 

All 



7 
8 

11 

'! ! 



A! ! 



Agreements + Disagreements 



0 

0 

1 
1 

0 

0 

1 
1 



none 



1 
2 

1 
1 

2 
6 

2 
4 

2^ 
3 

16 

n 

o 

o 

l 
i 

0 

1 

I 

2 



Percent 
Agreement 



100% 



100% 



50% 
100% 

33% 
50% 
67% 
50% 



100% 

07, 
50" 
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Category 



Observer 



A greements 



Agreements + Disagreements 



Percent 
Agreement 



Teacher- Initiated 
Work 
Praise 



Lower Level 



Teacher- Initiated 
Procedural 



2 
5 
7 

8 
11 
All 



5 
7 

8 

11 

All 



11 



All 



1 
I 

0 
1 



2 
3 

1 
1 

1 
1 

4 
6 

1 

f 



100% 



100% 
0% 

67% 
100% 
100% 

67% 



100% 
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Category Observer Agreements Percent 

Agreements + Disagreements Agreement 



Behavioral 

Criticism 2 3 

3 

i 5 0 

7 4 

5 

8 I 

1 

11 I 

1 



All _9 90% 

10 



ERIC 1 ' 
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Appendix D 

Teacher-Pupil Interactions: Two Year Plots 



ERLC 



T 



HEWLETT 
PACKARD 



T 



RESPONSE OPPORTUNITY - DISCIPLINE MF/D 



2 



J 

/ 



I 



+ 



6TH GRADE 



7TH GRADE 



8TH GRADE 



9 

ERIC 



# 

l 

2 
3 
4 



GROUP NAME 
FEMALE HIGH CONF 
FEMALE LOW CONF 
MALE HIGH CONF 
MALE LOW CONF 



6TH GRADE 



« 



7TH GRADE 
.01 
0.00 
.01 
.01 



8TH GRADE 
0.00 
0.00 
.02 
0. 00 



4> 



( 



f 



TEACHER INITIATED BEHAVIORAL - PRAISE MF/D 



PALKABO 



( 



1 



. 8 



. 4 



.4 



. 2 



. 2 



1 

6TH GRADE 



0 



7TH GRADE 



9TH GRADE 



# GROUP NAME 6TH GRADE 7TH GRADE 8TH GRADE 

1 — FEMALE HIGH f -ONF * 0.00 0.00 

2 FEMALE LOW CONF # 0.00 0.00 , 

3 MALE HIGH CONF # 0.00 0.00 r 

*ER?C^-- 4 MALE LOW CONF # 0.00 0.00 1^2 



a-. 



T 



HCWLCTT 
PACKARD 



T 



STUDENT ANSWER - PART CORRECT MF/D 



2 -r- 



2 



1 



__ 1 




1 

6TH GRADE 



7TH GRADE 



8TH GRADE 



JO" 

j.-^ ..» 



1 



9 

ERIC 



l 

2 
3 
4 



GROUP NAME 
FEMALE HIGH CONF 
FEMALE LOW CONF 
MALE HIGH CONF 
MALE LOW CONF 



6TH GRADE 

* 

« 

* 

* 



7TH GRADE 
. 08 
.06 
. 14 
. 11 



8TH GRADE 
.132 
.02 
.04 
.04 



2 -r- 



HEWLETT 
PACKARD 



( 



STUDENT ANSWER - NO RESPONSE MF/D 



1 



1 — — 

6TH GRADE 



7TH GRADE 



8TH GRADE 



# 

1 
2 

is: 3 



9 

ERIC 



GROUP NAME 
FEMALE HIGH <JONF 
FEMALE LOW CONF 
MALE HIGH CONF 
MALE LOW CONF 



6TH GRADE 
» 



7TH GRADE 
. 04 
. 03 
.07 
.07 



8TH GRADE 
.35 
.02 
.02 
.04 



STUDENT INITIATED WORK - PRAISE MF/D 

* 



6TH GRADE 7TH GRADE 8TH GRADE 

1 • 

\ 

§ GROUP NAME 6TH GRADE 7TH GRADE 8TH GRADE 

x FEMALE HIGH CONF # .01 .01 

2 FEMALE LOW CONF • .01 .01 

3 MALE HIGH CONF • 0.00 .01 

4 MALE LOW CONF • 0.00 .03 



( 



STUDENT INITIATED WORK - CRITICISM MF/D 



+ 



6TH GRADE 



7TH GRADE 



8TH GRADE 



# 

1 

3 

4 i<J! 



GROUP NAME 



6TH GRADE 



FEMALE HIGH CONF 



FEMALE LOW CONF 
MALE HIGH CONF 
MALE LOW CONF 



7TH GRADE 



* 
» 



0. 00 
.01 
.01 



8TH GRAC: 
~ 0. 00 ~ 
.02 
.02 
.02 



7 ( rassss T 

TEACHER INITIATED WORK - PRAISE MF/D 



6TH GRADE 7TH GRADE 8TH GRADE 



# GROUP NAME 6TH GRADE 7TH GRADE 8TH GRADE 

1 FEMALE HIGH CCNF * ,21 .02 

2 FEMALE LOW „ONF # .02' .01 

3 MALE HIGH CONF # .01 .01 

4 MALE LOW CONF » .02 .02 



STUDENT INITIATED PROCEDURAL - CRITICISM MF/D 



. 8 -- 



. e 



. 8 



.4 __ 



. 2 „ 



+ 



6TH GRADE 



7TH GRADE 



8TH GRADE 



i 



ERIC 



# 

l 

2 
3 
4 



GROUP NAME 
FEMALE HIGH CONF 
FEMALE LOW CONF 
MALE HIGH CONF 
MALE LOW CONF 



6TH GRADE 



i 0' 

A w w 



7TH GRADE 

a. m 
0.00 
.01 

.02 



8TH GRADE 
' 0.00 
0.00 
.02 
.01 



id ; 



STUDENT INITIATED PROCEDURAL - PRAISE MF/D 



) 



♦ 



1 

6TH GRADE 



+ 

7TH GRADE 



■ -*i 



8TH GRADE 



# 

1 
2 
3 
4 



GROUP NAME 
FEMALE HIGH CONF 
FEMALE LOW CONF 
MALE HIGH CONF 
MALE LOW CONF 



8TH GRADE 



7TH GRADE 

0. 00 
0.^00 

0.S30 
0.00 



8TH GRADE 

0.*00 
.01 
0.00 
. 0.00 



1 



TEACHER INITIATED PROCEDURAL MF/D 



.8 



. 8 



.2 * 



0 



M HEWLETT 
PAr«<A»0 



( 




6TH GRADE 



7TH GRADE 



8TH GRADE 



ERIC 



# 

l 

2 
3 
4 



i 



GROUP NAME 
FEMALE HIGH CONF 
FEMALE LOW CONF 
MALE HIGH CONF 
MALE LOW CONF 



6TH GRADE 
# 

* 



7TH GRADE 
.04 
.09 
.08 
.05 



8TH GRADE 
.12 
.13 
. 14 
. 14 



T 



T 

TEACHER INITIATED WORK - DON'T KNOW MF/D 



PACKARD 



T 



+ 




6TH GRADE 



7TH GRADE 



8TH GRADE 



# 

1 
2 
3 
4 



GROUP NAME 

FEMALE HIGH CONF 
FEMALE LOW CONF 
MALE HIGH CONF 
MALE LOW CONF 



6TH GRADE 



7TH GRADE 
.05 
.03 
.04 
.01 



8TH GRADE 
.02 
.04 
.03 
.02 



I _ 



. 2 



( ( 

TEACHER INITIATED WORK - CRITICISM MF/D 



mrijm hcwlett 

iXl PACKARD 



( 



. e 



. 8 



.4 



__ . 2 



CBMM 



6TH GRADE 



7TH GRADE 



8TH GRADE 



# GROUP NAME 6TH GRADE 7TH GRADE 8TH GRADE 

1 • FEMALE HIGH CONF * .02 .02 

2 FEMALE LOW CONF * .01 .01 

3 MALE HIGH CONF • .02 .04 



ERIC 4 o,, 



MALE LOW CONF * .09 .02 



TEACHER INITIATED WORK - LOW LEVEL MF/D 



H 1 1- 



6TH GRADE 7TH GRADE 8TH GRADE 

# GROUP NAME 6TH GRADE 7TH GRADE 8TH GRADE t 

1 — FEMALE HIGH CONF » .08 .13 

2 FEMALE LOW CONF » .06 .15 

3 MALE HIGH CONF • .07 .15 

4 MALE LOW CONF « .08 .13 



f 

TEACHER INITIATED WORK - HIGH LEVEL MF/O 



6TH GRADE 7TH GRADE 8TH GRADE 



# GROUP NAME* 6TH GRADE 7TH GRADE 8TH GRADE 

1 FEMALE HIGH CONF * 0.20 .02 

2 FEMALE LOW CONF ♦ .01 .02 

3 MALE HIGH CONF * .02 .01 

4 MALE LOW CONF » .01 .02 



T 



# OF DAYS PRESENT 



20 -r- 



T 



fHg HCWLXTT f 
■99 PACKARD \ 



__ 20 



13 __ 




IS 



10 



10 



5 



__ 5 



1 — 

7TH GRADE 



+ 



6TH GRADE 



8TH GRADE 



On ) 



9 

ERIC 



l 

2 
3 
4 



GROUP NAME 
FEMALE HIGH CONF 
FEMALE LOW CONF 
MALE HIGH CONF 
MALE LOW CONF 



6TH GRADE 

« 

« 



7TH GRADE 
16. 45 
16. 65 
17.37 
16. 50 



8TH GRADE 

14. 85 

15. 30 
15.27 
14. 55 



( 



STUDENT INITIATED WORK - DON'T KNOW MF/D 



rt2* HEWLETT 
IflEI PACKARO 



( 



_ X 



. s 



4 



2 __ » 



0 




1 

6TH GRADE 



+ 



+ 



. 4 



. 2 



7TH GRADE 



8TH GRADE 



9 

ERIC 



# 

i 

2 
3 
4 



GROUP NAME 
FEMALE HIGH CONK 
FEMALE LOW CONF 
MALE 'IGH CONF 
MALE LOW CONF 



6TH GRADE 



# 
« 



7TH GRADE 
.06 
.05 
.13 
.04 



8TH GRADE 
.08 
. 10 
.09 
.06 



O 



I 8 I rtssxg ( 

STUDENT INITIATED PROCEDURAL - NEUTRAL MF/D 

l — - 




6TH GRADE 7TH GRADE 8TH GRADE 



# GROUP NAME 6TH GRADE 7TH GRADE 8TH GRADE 

° k 1 FEMALE HIGH CQNF < # .15 « . 27 . 

21 2 FEMALE LOW CONF » - .10 .21 

3 MALE HIGH CONF ♦ . 22 . 26 

4 MALE LOW CONF # .13 . |}'o 

er|c 



Appendix E 
Teacher Feedback - Two Year Plots 
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< 



T 



T 



G3 



HSWUTT 
PACKARD 



T 



FEEDBACK - POSITIVE'MF/D 



2 _ 



__ 2 



1 




+ 



6TH GRADE 



f 

7TH GRADE 



+ 



8TH GRADE 



2 1 



9 

ERIC 



l 

2 
3 
4 



GROUP NAME 
FEMALE HIGH CONF 
FEMALE LOW CONF 
MALE HIGH CONF 
MALE LOW CONF 



6TH GRADE 



* 



7TH GRADE 
. 42 
.37 
.83 
• .50 



8TH GRADE * " 



. 15 
.24 
.33 
.35 



( 



H HEWLETT 
PACKAW) 



FEEDBACK - NEUTRAL MF/D 



2 



2 



1 



\ 



3 « 
4 



0 



1 

6TH GRADE 



+ 



7TH GRADE 



8TH GRADE 



0 



ERIC 



# 

l 

2 
3 
4 



'> i Q 



GROUP NAME 
FEMALE HIGH CONF 
FEMALE LOW CONF 
MALE HIGH CONF 
MALE LOW CONF 



6TH GRADE 

« 

* 

* 

« 



7TH GRADE 
.76 
.89 
1.55 
1.04 



8TH GRADE 
.33 
.34 
.61 
.49 



2iJ 



( 



( 



fa 



FEEDBACK - SUSTAINING MF/D 



2 _ 



1 



^ 

7TH GRADE 



31 



1 



6TH GRADE 



8TH GRADE 



ERIC 



# 

l 

2 
3 
4 



GROUP NAME 
FEMALE HIGH CONF 
FEMALE LOW CONF 
MALE HIGH CONF 
MALE LOW CONF 



6TH GRADE 



7TH GRADE 
.21 
.18 
.37 
.31 



8TH GRADE 2 J. 
.06 
.05 
. 10 
.09 



( 



( 



HEWLETT 
PACKARD 



( 



FEEDBACK - NEGATIVE MF/D 



2 _ 



1 



-r- 2 



1 

6TH GRADE 



+ 




7TH GRADE 



8TH GRADE 



ERIC 



l 
2 



4 «•>•"•'> 

4v 



.GROUP NAME 
FEMALE HIGH CONF 
FEMALE LOW CONF 
MALE HIGH CONF 
MALE LOW CONF 



6TH GRADE 



# 



7TH GRADE 
. 11 

• 11 

.22 

. 19 



8TH GRADE 
.02 
.07 
. 12 
. 11 



<* v> 



( 

2 _ 



« HEWLETT 
MCKADO 



STUDENT ANSWER - INCORRECT MF/D 



i 



0 



I— 



» 

6TH GRADE 



+- 



5! 



7TH GRADE 



8TH GRADE 



ERIC 



# 

1 

2 
3 
4 



GROUP NAME 
FEMALE HIGH CONF 
FEMALE LOW CONF 
MALE HIGH CONF 
MALE LOW CONF 



6TH GRADE 



« 



7TH GRADE 
.08 
.08 
. 17 
. 17 



8TH GRADE 
.02 
.05 
. 10 
.09 



» * f 0- ^ f 

f % |X3|MBWL«rr I 

\ % MOM PACKARD \ 

STUDENT ANSWER - CORRECT MF/D 




j ). 1 1 

6TH GRADE 7TH GRADE 8TH GRADE 

# GROUP NAME 6TH GRADE 7TH GRADE 8TH GRADE 

! FEMALE HIGH CONF * .72 .32 

2 FEMALE LOW CONF ♦ .69 .31 

3 MALE HIGH CONF * 1. 04 . 43 

4 2'Sj MALE LOW CONF • .85 .51 



